2024-09-13T17:56:29.508 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T17:56:29.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:56:29.632 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957 branch: wip-rishabh-testing-20240910.100730-reef description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/test_o_trunc}} email: null first_in_suite: false job_id: '7903957' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYSmib+W79B77ZjGOlXFFHjN5jd28HhoLFPUTrraRNsqqYn5i/fMnkuKtorgzS/jeisZpQaPaOOeBLZmmlo0SE= smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSzNc/h96ppjYlIAR/9aPYGVZsqjDEJwgbKRrMJXLr5WKEheqOWg7m6c/6nELX3X+Hvf7DVKdrVxcmnHrZWHlg= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBWxkrTXAGT++vXN7ZekWH8D3H0wDENBeW7OBv5HuDT3q8C0uNwIz1KyS40rqNCgv5tzTc8RGPzQaxVFK8tMW4Y= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T17:56:29.632 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T17:56:29.633 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T17:56:29.633 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T17:56:29.634 INFO:teuthology.task.internal:Checking packages... 2024-09-13T17:56:29.655 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T17:56:29.656 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T17:56:29.656 INFO:teuthology.packaging:ref: None 2024-09-13T17:56:29.656 INFO:teuthology.packaging:tag: None 2024-09-13T17:56:29.656 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:56:29.656 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:56:29.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:56:29.804 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T17:56:29.806 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T17:56:29.813 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T17:56:29.813 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T17:56:29.833 INFO:teuthology.task.internal:Saving configuration 2024-09-13T17:56:29.852 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T17:56:29.859 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T17:56:29.891 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:51:24.643628', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYSmib+W79B77ZjGOlXFFHjN5jd28HhoLFPUTrraRNsqqYn5i/fMnkuKtorgzS/jeisZpQaPaOOeBLZmmlo0SE='} 2024-09-13T17:56:29.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:51:24.641257', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSzNc/h96ppjYlIAR/9aPYGVZsqjDEJwgbKRrMJXLr5WKEheqOWg7m6c/6nELX3X+Hvf7DVKdrVxcmnHrZWHlg='} 2024-09-13T17:56:29.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:51:24.642555', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBWxkrTXAGT++vXN7ZekWH8D3H0wDENBeW7OBv5HuDT3q8C0uNwIz1KyS40rqNCgv5tzTc8RGPzQaxVFK8tMW4Y='} 2024-09-13T17:56:29.946 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T17:56:29.953 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-13T17:56:29.953 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-13T17:56:29.953 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-13T17:56:29.953 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T17:56:30.050 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb2c3f20670>, signals=[15]) 2024-09-13T17:56:30.050 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T17:56:30.057 INFO:teuthology.task.internal:Opening connections... 2024-09-13T17:56:30.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T17:56:30.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:56:30.158 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-09-13T17:56:30.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:56:30.246 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-13T17:56:30.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:56:30.329 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T17:56:30.336 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-13T17:56:30.355 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-13T17:56:30.355 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-13T17:56:30.413 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:56:30.414 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:56:30.415 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:56:30.415 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:56:30.415 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:56:30.415 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:56:30.416 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-13T17:56:30.442 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-09-13T17:56:30.460 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-09-13T17:56:30.460 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-09-13T17:56:30.518 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:56:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:56:30.520 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:56:30.520 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-09-13T17:56:30.551 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-13T17:56:30.569 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-13T17:56:30.570 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-13T17:56:30.627 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-09-13T17:56:30.627 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:56:30.628 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:56:30.629 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-13T17:56:30.659 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T17:56:30.669 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T17:56:30.677 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T17:56:30.677 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:56:30.681 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:56:30.684 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:56:30.701 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T17:56:30.708 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T17:56:30.709 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:56:30.739 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:56:30.741 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:56:30.768 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T17:56:30.861 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T17:56:30.876 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T17:56:30.876 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-13T17:56:30.876 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-13T17:56:30.876 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:56:30.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:56:30.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T17:56:31.066 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:56:31.066 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T17:56:31.066 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-13T17:56:31.084 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-503.el9.x86_64 2024-09-13T17:56:31.084 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:56:31.084 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T17:56:31.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum upgrade -y linux-firmware 2024-09-13T17:56:34.667 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-13T17:56:36.493 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-13T17:56:41.286 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-13T17:56:42.795 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-13T17:56:43.974 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-13T17:56:49.721 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-13T17:56:51.925 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-13T17:56:51.926 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2024-09-13T17:56:51.926 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-13T17:56:52.009 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:56:52.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:56:52.159 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T17:56:52.159 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T17:56:52.162 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi007.front.sepia.ceph.com to complete... 2024-09-13T17:56:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13 17:56:59 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T17:56:59.004 INFO:teuthology.orchestra.run.smithi007.stderr:FINISHED --2024-09-13 17:56:59-- 2024-09-13T17:56:59.005 INFO:teuthology.orchestra.run.smithi007.stderr:Total wall clock time: 6.8s 2024-09-13T17:56:59.005 INFO:teuthology.orchestra.run.smithi007.stderr:Downloaded: 1 files, 343M in 6.4s (53.8 MB/s) 2024-09-13T17:56:59.007 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:56:59.007 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T17:57:01.229 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying... ######################################## 2024-09-13T17:57:01.367 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing... ######################################## 2024-09-13T17:57:01.486 INFO:teuthology.orchestra.run.smithi007.stdout:Updating / installing... 2024-09-13T17:57:09.864 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T17:57:50.418 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T17:57:50.419 DEBUG:teuthology.orchestra.run.smithi007:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T17:57:50.509 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.509 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.509 INFO:teuthology.orchestra.run.smithi007.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.509 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.509 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T17:57:50.509 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T17:57:50.510 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T17:57:50.511 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T17:57:50.512 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T17:57:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T17:57:50.514 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T17:57:50.515 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T17:57:50.516 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T17:57:50.517 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T17:57:50.518 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T17:57:50.519 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T17:57:50.520 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T17:57:50.521 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T17:57:50.522 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T17:57:50.523 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T17:57:50.524 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T17:57:50.525 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T17:57:50.526 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T17:57:50.527 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T17:57:50.528 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T17:57:50.529 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T17:57:50.530 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T17:57:50.531 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T17:57:50.532 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T17:57:50.533 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T17:57:50.534 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T17:57:50.535 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T17:57:50.536 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T17:57:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T17:57:50.538 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T17:57:50.539 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T17:57:50.540 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T17:57:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T17:57:50.542 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T17:57:50.543 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T17:57:50.544 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T17:57:50.545 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T17:57:50.546 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T17:57:50.547 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T17:57:50.548 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T17:57:50.549 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T17:57:50.550 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T17:57:50.551 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T17:57:50.552 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T17:57:50.553 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T17:57:50.554 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T17:57:50.555 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T17:57:50.556 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T17:57:50.557 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T17:57:50.558 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T17:57:50.559 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T17:57:50.560 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T17:57:50.561 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T17:57:50.562 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T17:57:50.563 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T17:57:50.564 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T17:57:50.565 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T17:57:50.566 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T17:57:50.567 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T17:57:50.568 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T17:57:50.569 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T17:57:50.570 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T17:57:50.571 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T17:57:50.572 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T17:57:50.573 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T17:57:50.574 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T17:57:50.575 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T17:57:50.576 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T17:57:50.577 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T17:57:50.578 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T17:57:50.579 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T17:57:50.580 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T17:57:50.581 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T17:57:50.582 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T17:57:50.583 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T17:57:50.584 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T17:57:50.585 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T17:57:50.586 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T17:57:50.587 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T17:57:50.588 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T17:57:50.589 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T17:57:50.590 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T17:57:50.591 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T17:57:50.592 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T17:57:50.593 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T17:57:50.594 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T17:57:50.595 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T17:57:50.596 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T17:57:50.597 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T17:57:50.598 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T17:57:50.599 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T17:57:50.600 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T17:57:50.601 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T17:57:50.602 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T17:57:50.603 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T17:57:50.604 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T17:57:50.605 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T17:57:50.606 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T17:57:50.607 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T17:57:50.608 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T17:57:50.609 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T17:57:50.610 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T17:57:50.611 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T17:57:50.612 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T17:57:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T17:57:50.614 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T17:57:50.615 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T17:57:50.616 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T17:57:50.617 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T17:57:50.618 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T17:57:50.619 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T17:57:50.620 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T17:57:50.621 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T17:57:50.622 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T17:57:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T17:57:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T17:57:50.625 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T17:57:50.626 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T17:57:50.627 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T17:57:50.628 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T17:57:50.629 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T17:57:50.630 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T17:57:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T17:57:50.632 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T17:57:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T17:57:50.634 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T17:57:50.635 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T17:57:50.636 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T17:57:50.637 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T17:57:50.638 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T17:57:50.639 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T17:57:50.640 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T17:57:50.641 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T17:57:50.642 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T17:57:50.643 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T17:57:50.644 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T17:57:50.645 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T17:57:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T17:57:50.647 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T17:57:50.648 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T17:57:50.649 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T17:57:50.650 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T17:57:50.651 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T17:57:50.652 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T17:57:50.653 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T17:57:50.654 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T17:57:50.655 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T17:57:50.656 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T17:57:50.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T17:57:50.657 INFO:teuthology.orchestra.run.smithi007.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T17:57:50.661 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.661 DEBUG:teuthology.orchestra.run.smithi007:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout:for file in vmlinuz System.map config; do 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T17:57:50.684 INFO:teuthology.orchestra.run.smithi007.stdout: fi 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:done 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.685 INFO:teuthology.orchestra.run.smithi007.stdout:fi 2024-09-13T17:57:50.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-09-13T17:57:50.770 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-09-13T17:57:50.770 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-09-13T17:57:50.770 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-09-13T17:57:50.770 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 82.el9 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8274670 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T17:57:50.771 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T17:57:50.772 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T17:57:50.773 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T17:57:50.773 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:50.773 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T17:57:51.383 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-13T17:57:52.751 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T17:57:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-13T17:57:52.779 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-13T17:57:52.795 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.rkVCmbbT8L 2024-09-13T17:57:52.795 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rkVCmbbT8L 2024-09-13T17:57:52.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.rkVCmbbT8L 2024-09-13T17:57:53.000 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.rkVCmbbT8L is 6KB 2024-09-13T17:57:53.048 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.rkVCmbbT8L 2024-09-13T17:57:53.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T17:57:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T17:57:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T17:57:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T17:57:53.126 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T17:57:53.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:57:53.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-13T17:58:23.312 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T17:58:23.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T17:58:23.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:59:23.325 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T17:59:32.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T17:59:32.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:59:35.798 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-13T17:59:36.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T17:59:36.365 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T17:59:36.365 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-13T17:59:36.399 INFO:teuthology.orchestra.run.smithi007.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:59:36.399 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:59:36.400 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:59:36.400 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T17:59:37.403 DEBUG:teuthology.parallel:result is None 2024-09-13T17:59:37.404 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T17:59:37.411 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T17:59:37.411 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:59:37.415 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:59:37.418 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:59:37.448 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T17:59:37.482 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T17:59:37.492 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T17:59:37.493 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:59:37.497 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:59:37.499 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:59:37.610 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T17:59:37.616 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T17:59:37.616 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:59:37.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:59:37.633 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:59:37.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:59:37.650 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:59:37.654 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:59:37.677 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:59:37.728 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:59:37.742 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:59:37.743 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:59:37.763 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:59:37.765 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:59:37.847 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:59:37.850 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T17:59:37.857 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T17:59:37.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:59:37.861 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:59:37.863 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:59:37.914 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T17:59:37.923 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T17:59:37.923 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:59:37.926 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:59:37.933 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:59:37.957 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:59:38.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:59:38.139 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:59:38.209 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:59:38.274 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T17:59:38.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:59:38.350 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:59:38.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:59:38.448 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:59:38.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:59:38.576 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T17:59:38.576 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:59:38.642 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:59:38.685 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:59:38.742 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:59:38.836 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:59:38.869 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T17:59:38.869 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:59:38.936 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-13T17:59:38.940 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-09-13T17:59:38.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-13T17:59:38.979 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:59:39.008 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:59:39.025 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:59:39.505 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T17:59:39.513 INFO:teuthology.task.internal:Starting timer... 2024-09-13T17:59:39.513 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T17:59:39.533 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T17:59:39.544 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-13T17:59:39.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-09-13T17:59:39.638 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-09-13T17:59:39.641 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-09-13T17:59:39.698 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-09-13T17:59:39.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-09-13T17:59:39.760 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-09-13T17:59:39.762 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T17:59:39.763 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-09-13T17:59:39.804 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-09-13T17:59:39.804 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-09-13T17:59:39.830 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-09-13T17:59:39.831 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-09-13T17:59:39.855 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-09-13T17:59:39.856 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive'} 2024-09-13T17:59:39.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:59:39.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:59:39.917 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:59:39.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:59:39.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:59:39.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:59:39.978 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T17:59:39.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:59:40.102 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:59:40.134 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:59:40.167 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T17:59:40.177 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T17:59:40.179 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T17:59:40.335 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T17:59:40.345 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T17:59:40.346 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi067.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:04:22.197 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2024-09-13T18:04:22.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T18:04:22.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:04:22.300 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-13T18:04:22.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T18:04:22.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-13T18:04:22.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:04:22.507 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-13T18:04:22.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-13T18:04:22.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-13T18:04:22.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:04:22.675 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-13T18:04:22.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-13T18:04:22.763 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:04:22.774 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:04:22.774 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:04:22.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:04:22.779 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:04:22.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:04:22.782 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:04:22.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:04:22.811 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:04:22.826 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:04:22.836 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:04:22.838 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:04:22.851 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:04:22.852 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-09-13T18:04:22.863 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-09-13T18:04:22.868 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:04:22.878 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:04:22.878 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-09-13T18:04:22.889 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-09-13T18:04:22.892 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:04:22.904 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:04:22.917 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:04:22.919 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-09-13T18:04:22.944 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-09-13T18:04:22.949 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:04:22.952 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:04:22.952 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-13T18:04:22.952 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:22.952 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:22.953 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:22.953 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:22.973 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:04:22.981 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:04:22.984 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:04:22.984 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-13T18:04:22.984 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:22.984 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:22.984 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:22.984 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:23.002 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:04:23.107 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:04:23.113 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:04:23.114 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-13T18:04:23.114 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:23.114 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:23.114 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:23.114 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:04:23.115 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:04:23.123 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:04:23.123 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:04:23.123 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:04:23.123 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:04:23.129 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:04:23.129 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:04:23.129 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:04:23.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:04:23.132 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:04:23.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:04:23.133 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:04:23.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:04:23.289 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:04:23.290 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:04:23.304 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:04:23.304 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:04:23.316 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:04:23.316 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:04:23.416 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:04:23.416 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:04:23.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:04:23.421 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:04:23.421 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:04:23.421 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:04:23.436 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:04:23.436 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:04:23.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:04:23.447 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:04:23.448 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:04:23.463 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:04:23.463 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:04:23.472 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:04:23.472 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:04:23.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:04:23.529 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:04:23.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:04:23.589 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:04:23.604 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:04:23.653 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-09-13T18:04:23.654 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:04:23.655 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-09-13T18:04:23.668 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-09-13T18:04:23.670 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-09-13T18:04:23.711 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-09-13T18:04:23.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-09-13T18:04:23.886 INFO:teuthology.orchestra.run.smithi067.stdout:45 files removed 2024-09-13T18:04:23.893 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-09-13T18:04:23.914 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:04:23.920 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:04:23.986 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-09-13T18:04:24.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:04:24.463 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 293 kB/s | 78 kB 00:00 2024-09-13T18:04:24.480 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 275 kB/s | 78 kB 00:00 2024-09-13T18:04:24.724 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 266 kB/s | 78 kB 00:00 2024-09-13T18:04:24.738 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 49 kB/s | 11 kB 00:00 2024-09-13T18:04:24.773 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-13T18:04:25.006 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-13T18:04:25.041 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-09-13T18:04:25.048 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-13T18:04:25.367 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-09-13T18:04:25.472 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-13T18:04:25.615 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-13T18:04:27.200 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-13T18:04:27.449 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-13T18:04:27.507 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-13T18:04:29.785 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-13T18:04:31.842 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-13T18:04:32.058 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-13T18:04:33.634 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 19 kB 00:00 2024-09-13T18:04:33.935 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 19 kB 00:00 2024-09-13T18:04:35.129 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-13T18:04:35.272 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-13T18:04:35.352 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-13T18:04:37.029 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-13T18:04:38.383 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-13T18:04:40.594 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-13T18:04:40.962 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-13T18:04:42.887 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:04:42.887 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:04:42.898 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:04:42.899 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:04:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:04:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:04:42.902 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:04:42.904 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:04:42.905 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:04:42.965 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:04:42.987 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:04:42.988 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:04:42.989 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:04:42.990 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:04:42.991 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:04:42.992 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:04:42.993 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:04:42.994 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:04:42.995 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:04:42.996 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:04:42.997 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout:Install 130 Packages 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 8 Packages 2024-09-13T18:04:42.998 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:04:42.999 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 203 M 2024-09-13T18:04:42.999 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-13T18:04:43.315 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:04:43.316 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:04:43.329 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:04:43.330 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:04:43.331 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:04:43.332 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:04:43.334 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:04:43.337 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:04:43.338 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:04:43.405 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-13T18:04:43.426 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================== 2024-09-13T18:04:43.426 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-09-13T18:04:43.426 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================== 2024-09-13T18:04:43.426 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-13T18:04:43.426 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:04:43.427 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:04:43.428 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:04:43.429 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:04:43.430 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:04:43.431 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:04:43.432 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:04:43.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:04:43.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:04:43.435 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:04:43.436 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:04:43.437 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================== 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout:Install 130 Packages 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 8 Packages 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 203 M 2024-09-13T18:04:43.438 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-13T18:04:43.456 INFO:teuthology.orchestra.run.smithi116.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-13T18:04:43.645 INFO:teuthology.orchestra.run.smithi116.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 4.3 MB/s | 852 kB 00:00 2024-09-13T18:04:43.770 INFO:teuthology.orchestra.run.smithi116.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 11 MB/s | 5.1 MB 00:00 2024-09-13T18:04:43.796 INFO:teuthology.orchestra.run.smithi116.stdout:(4/138): ceph-immutable-object-cache-18.2.4-860 948 kB/s | 142 kB 00:00 2024-09-13T18:04:43.871 INFO:teuthology.orchestra.run.smithi116.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 21 MB/s | 2.1 MB 00:00 2024-09-13T18:04:44.013 INFO:teuthology.orchestra.run.smithi116.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 6.7 MB/s | 1.5 MB 00:00 2024-09-13T18:04:44.130 INFO:teuthology.orchestra.run.smithi116.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-13T18:04:44.322 INFO:teuthology.orchestra.run.smithi116.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 18 MB/s | 18 MB 00:00 2024-09-13T18:04:44.338 INFO:teuthology.orchestra.run.smithi067.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-13T18:04:44.372 INFO:teuthology.orchestra.run.smithi116.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 506 kB/s | 25 kB 00:00 2024-09-13T18:04:44.930 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-13T18:04:45.098 INFO:teuthology.orchestra.run.smithi116.stdout:(10/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 15 MB/s | 17 MB 00:01 2024-09-13T18:04:45.165 INFO:teuthology.orchestra.run.smithi116.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.3 MB/s | 224 kB 00:00 2024-09-13T18:04:45.213 INFO:teuthology.orchestra.run.smithi067.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 974 kB/s | 852 kB 00:00 2024-09-13T18:04:45.223 INFO:teuthology.orchestra.run.smithi116.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 534 kB/s | 31 kB 00:00 2024-09-13T18:04:45.307 INFO:teuthology.orchestra.run.smithi116.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 8.3 MB/s | 712 kB 00:00 2024-09-13T18:04:45.388 INFO:teuthology.orchestra.run.smithi067.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 4.3 MB/s | 5.1 MB 00:01 2024-09-13T18:04:45.414 INFO:teuthology.orchestra.run.smithi067.stdout:(4/138): ceph-immutable-object-cache-18.2.4-860 712 kB/s | 142 kB 00:00 2024-09-13T18:04:45.415 INFO:teuthology.orchestra.run.smithi116.stdout:(14/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 6.0 MB/s | 7.7 MB 00:01 2024-09-13T18:04:45.440 INFO:teuthology.orchestra.run.smithi116.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 1.2 MB/s | 166 kB 00:00 2024-09-13T18:04:45.508 INFO:teuthology.orchestra.run.smithi116.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 7.0 MB/s | 478 kB 00:00 2024-09-13T18:04:45.566 INFO:teuthology.orchestra.run.smithi116.stdout:(17/138): librados-devel-18.2.4-860.g6c6b083f.e 843 kB/s | 127 kB 00:00 2024-09-13T18:04:45.614 INFO:teuthology.orchestra.run.smithi067.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 9.3 MB/s | 2.1 MB 00:00 2024-09-13T18:04:45.633 INFO:teuthology.orchestra.run.smithi116.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 675 kB/s | 45 kB 00:00 2024-09-13T18:04:45.766 INFO:teuthology.orchestra.run.smithi116.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 971 kB/s | 129 kB 00:00 2024-09-13T18:04:45.964 INFO:teuthology.orchestra.run.smithi067.stdout:(6/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-13T18:04:46.150 INFO:teuthology.orchestra.run.smithi116.stdout:(20/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 22 MB/s | 40 MB 00:01 2024-09-13T18:04:46.175 INFO:teuthology.orchestra.run.smithi116.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 396 kB/s | 162 kB 00:00 2024-09-13T18:04:46.242 INFO:teuthology.orchestra.run.smithi116.stdout:(22/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 6.1 MB/s | 4.5 MB 00:00 2024-09-13T18:04:46.268 INFO:teuthology.orchestra.run.smithi116.stdout:(23/138): python3-rados-18.2.4-860.g6c6b083f.el 2.7 MB/s | 321 kB 00:00 2024-09-13T18:04:46.281 INFO:teuthology.orchestra.run.smithi067.stdout:(7/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 1.7 MB/s | 1.5 MB 00:00 2024-09-13T18:04:46.301 INFO:teuthology.orchestra.run.smithi116.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T18:04:46.327 INFO:teuthology.orchestra.run.smithi116.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.4 MB/s | 87 kB 00:00 2024-09-13T18:04:46.352 INFO:teuthology.orchestra.run.smithi116.stdout:(26/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 1.7 MB/s | 301 kB 00:00 2024-09-13T18:04:46.427 INFO:teuthology.orchestra.run.smithi116.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 326 kB/s | 24 kB 00:00 2024-09-13T18:04:46.452 INFO:teuthology.orchestra.run.smithi116.stdout:(28/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 1.3 MB/s | 172 kB 00:00 2024-09-13T18:04:46.486 INFO:teuthology.orchestra.run.smithi116.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.3 MB/s | 139 kB 00:00 2024-09-13T18:04:46.565 INFO:teuthology.orchestra.run.smithi067.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 7.8 MB/s | 18 MB 00:02 2024-09-13T18:04:46.570 INFO:teuthology.orchestra.run.smithi116.stdout:(30/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 11 MB/s | 3.0 MB 00:00 2024-09-13T18:04:46.620 INFO:teuthology.orchestra.run.smithi116.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 4.8 MB/s | 246 kB 00:00 2024-09-13T18:04:46.679 INFO:teuthology.orchestra.run.smithi116.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 848 kB/s | 49 kB 00:00 2024-09-13T18:04:46.737 INFO:teuthology.orchestra.run.smithi116.stdout:(33/138): ceph-prometheus-alerts-18.2.4-860.g6c 283 kB/s | 16 kB 00:00 2024-09-13T18:04:46.740 INFO:teuthology.orchestra.run.smithi067.stdout:(9/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86_ 21 MB/s | 17 MB 00:00 2024-09-13T18:04:46.765 INFO:teuthology.orchestra.run.smithi067.stdout:(10/138): ceph-selinux-18.2.4-860.g6c6b083f.el9 126 kB/s | 25 kB 00:00 2024-09-13T18:04:46.821 INFO:teuthology.orchestra.run.smithi116.stdout:(34/138): ceph-mgr-diskprediction-local-18.2.4- 22 MB/s | 7.4 MB 00:00 2024-09-13T18:04:46.824 INFO:teuthology.orchestra.run.smithi067.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.8 MB/s | 224 kB 00:00 2024-09-13T18:04:46.846 INFO:teuthology.orchestra.run.smithi116.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 2.4 MB/s | 264 kB 00:00 2024-09-13T18:04:46.872 INFO:teuthology.orchestra.run.smithi116.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T18:04:46.891 INFO:teuthology.orchestra.run.smithi067.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 464 kB/s | 31 kB 00:00 2024-09-13T18:04:46.905 INFO:teuthology.orchestra.run.smithi116.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 312 kB/s | 18 kB 00:00 2024-09-13T18:04:46.975 INFO:teuthology.orchestra.run.smithi067.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 8.4 MB/s | 712 kB 00:00 2024-09-13T18:04:46.997 INFO:teuthology.orchestra.run.smithi116.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-09-13T18:04:47.042 INFO:teuthology.orchestra.run.smithi067.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.4 MB/s | 166 kB 00:00 2024-09-13T18:04:47.064 INFO:teuthology.orchestra.run.smithi116.stdout:(39/138): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-13T18:04:47.108 INFO:teuthology.orchestra.run.smithi067.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 1.9 MB/s | 127 kB 00:00 2024-09-13T18:04:47.123 INFO:teuthology.orchestra.run.smithi116.stdout:(40/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 5.3 MB/s | 3.5 MB 00:00 2024-09-13T18:04:47.148 INFO:teuthology.orchestra.run.smithi116.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-13T18:04:47.182 INFO:teuthology.orchestra.run.smithi116.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-13T18:04:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 6.2 MB/s | 478 kB 00:00 2024-09-13T18:04:47.207 INFO:teuthology.orchestra.run.smithi116.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T18:04:47.233 INFO:teuthology.orchestra.run.smithi116.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-13T18:04:47.258 INFO:teuthology.orchestra.run.smithi116.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-13T18:04:47.283 INFO:teuthology.orchestra.run.smithi116.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-13T18:04:47.333 INFO:teuthology.orchestra.run.smithi116.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 8.9 MB/s | 689 kB 00:00 2024-09-13T18:04:47.384 INFO:teuthology.orchestra.run.smithi116.stdout:(48/138): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-13T18:04:47.409 INFO:teuthology.orchestra.run.smithi116.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-13T18:04:47.434 INFO:teuthology.orchestra.run.smithi116.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-13T18:04:47.476 INFO:teuthology.orchestra.run.smithi116.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-13T18:04:47.501 INFO:teuthology.orchestra.run.smithi116.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-13T18:04:47.502 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:04:47.502 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:04:47.514 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:04:47.515 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:04:47.516 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:04:47.517 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:04:47.518 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:04:47.521 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:04:47.522 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:04:47.535 INFO:teuthology.orchestra.run.smithi116.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-13T18:04:47.560 INFO:teuthology.orchestra.run.smithi116.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-13T18:04:47.567 INFO:teuthology.orchestra.run.smithi067.stdout:(17/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 4.5 MB 00:00 2024-09-13T18:04:47.590 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:04:47.607 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:04:47.608 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:04:47.609 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-09-13T18:04:47.610 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:04:47.611 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:04:47.611 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:04:47.611 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:04:47.611 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:04:47.611 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:04:47.612 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:04:47.612 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:04:47.612 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-13T18:04:47.612 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:04:47.613 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:04:47.613 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:04:47.613 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:04:47.613 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:04:47.614 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:04:47.614 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:04:47.614 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:04:47.614 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:04:47.614 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:04:47.614 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:04:47.615 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:04:47.616 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:04:47.617 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:04:47.618 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:04:47.619 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:04:47.620 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:04:47.621 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-13T18:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout:Install 130 Packages 2024-09-13T18:04:47.623 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 8 Packages 2024-09-13T18:04:47.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:04:47.624 INFO:teuthology.orchestra.run.smithi116.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-13T18:04:47.624 INFO:teuthology.orchestra.run.smithi067.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 1.1 MB/s | 45 kB 00:00 2024-09-13T18:04:47.625 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 203 M 2024-09-13T18:04:47.625 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-13T18:04:47.636 INFO:teuthology.orchestra.run.smithi116.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-13T18:04:47.652 INFO:teuthology.orchestra.run.smithi116.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-13T18:04:47.686 INFO:teuthology.orchestra.run.smithi116.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-13T18:04:47.720 INFO:teuthology.orchestra.run.smithi116.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-13T18:04:47.745 INFO:teuthology.orchestra.run.smithi116.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-13T18:04:47.770 INFO:teuthology.orchestra.run.smithi116.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-13T18:04:47.804 INFO:teuthology.orchestra.run.smithi116.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-13T18:04:47.829 INFO:teuthology.orchestra.run.smithi116.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-13T18:04:47.879 INFO:teuthology.orchestra.run.smithi116.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-09-13T18:04:47.963 INFO:teuthology.orchestra.run.smithi116.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-13T18:04:47.968 INFO:teuthology.orchestra.run.smithi067.stdout:(19/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 32 MB/s | 40 MB 00:01 2024-09-13T18:04:47.993 INFO:teuthology.orchestra.run.smithi067.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 337 kB/s | 129 kB 00:00 2024-09-13T18:04:48.005 INFO:teuthology.orchestra.run.smithi116.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-13T18:04:48.018 INFO:teuthology.orchestra.run.smithi067.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 3.2 MB/s | 162 kB 00:00 2024-09-13T18:04:48.039 INFO:teuthology.orchestra.run.smithi116.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-13T18:04:48.052 INFO:teuthology.orchestra.run.smithi067.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 5.4 MB/s | 321 kB 00:00 2024-09-13T18:04:48.064 INFO:teuthology.orchestra.run.smithi116.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-13T18:04:48.077 INFO:teuthology.orchestra.run.smithi067.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.0 MB/s | 301 kB 00:00 2024-09-13T18:04:48.102 INFO:teuthology.orchestra.run.smithi067.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T18:04:48.131 INFO:teuthology.orchestra.run.smithi116.stdout:(69/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-13T18:04:48.136 INFO:teuthology.orchestra.run.smithi067.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.5 MB/s | 87 kB 00:00 2024-09-13T18:04:48.156 INFO:teuthology.orchestra.run.smithi007.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 40 kB/s | 6.5 kB 00:00 2024-09-13T18:04:48.173 INFO:teuthology.orchestra.run.smithi116.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-13T18:04:48.194 INFO:teuthology.orchestra.run.smithi067.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.9 MB/s | 172 kB 00:00 2024-09-13T18:04:48.245 INFO:teuthology.orchestra.run.smithi067.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 489 kB/s | 24 kB 00:00 2024-09-13T18:04:48.249 INFO:teuthology.orchestra.run.smithi116.stdout:(71/138): postgresql-server-13.16-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-09-13T18:04:48.274 INFO:teuthology.orchestra.run.smithi116.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-13T18:04:48.299 INFO:teuthology.orchestra.run.smithi116.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-13T18:04:48.304 INFO:teuthology.orchestra.run.smithi067.stdout:(28/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 15 MB/s | 3.0 MB 00:00 2024-09-13T18:04:48.324 INFO:teuthology.orchestra.run.smithi116.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-13T18:04:48.329 INFO:teuthology.orchestra.run.smithi067.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 1.6 MB/s | 139 kB 00:00 2024-09-13T18:04:48.350 INFO:teuthology.orchestra.run.smithi116.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-13T18:04:48.357 INFO:teuthology.orchestra.run.smithi007.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 4.2 MB/s | 852 kB 00:00 2024-09-13T18:04:48.375 INFO:teuthology.orchestra.run.smithi116.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-13T18:04:48.442 INFO:teuthology.orchestra.run.smithi116.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-13T18:04:48.467 INFO:teuthology.orchestra.run.smithi116.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-13T18:04:48.492 INFO:teuthology.orchestra.run.smithi116.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-13T18:04:48.517 INFO:teuthology.orchestra.run.smithi116.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T18:04:48.543 INFO:teuthology.orchestra.run.smithi116.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-13T18:04:48.568 INFO:teuthology.orchestra.run.smithi116.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T18:04:48.601 INFO:teuthology.orchestra.run.smithi116.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-13T18:04:48.627 INFO:teuthology.orchestra.run.smithi116.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-13T18:04:48.652 INFO:teuthology.orchestra.run.smithi116.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-13T18:04:48.736 INFO:teuthology.orchestra.run.smithi116.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-13T18:04:48.761 INFO:teuthology.orchestra.run.smithi116.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-13T18:04:48.774 INFO:teuthology.orchestra.run.smithi007.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 6.5 MB/s | 5.1 MB 00:00 2024-09-13T18:04:48.779 INFO:teuthology.orchestra.run.smithi067.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 7.4 MB/s | 3.5 MB 00:00 2024-09-13T18:04:48.786 INFO:teuthology.orchestra.run.smithi116.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-13T18:04:48.812 INFO:teuthology.orchestra.run.smithi116.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T18:04:48.824 INFO:teuthology.orchestra.run.smithi007.stdout:(4/138): ceph-immutable-object-cache-18.2.4-860 305 kB/s | 142 kB 00:00 2024-09-13T18:04:48.845 INFO:teuthology.orchestra.run.smithi116.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-13T18:04:48.871 INFO:teuthology.orchestra.run.smithi116.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-13T18:04:48.879 INFO:teuthology.orchestra.run.smithi067.stdout:(31/138): ceph-mgr-diskprediction-local-18.2.4- 13 MB/s | 7.4 MB 00:00 2024-09-13T18:04:48.896 INFO:teuthology.orchestra.run.smithi116.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-13T18:04:48.905 INFO:teuthology.orchestra.run.smithi067.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 1.9 MB/s | 246 kB 00:00 2024-09-13T18:04:48.907 INFO:teuthology.orchestra.run.smithi007.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 16 MB/s | 2.1 MB 00:00 2024-09-13T18:04:48.938 INFO:teuthology.orchestra.run.smithi067.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 847 kB/s | 49 kB 00:00 2024-09-13T18:04:48.946 INFO:teuthology.orchestra.run.smithi116.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-13T18:04:48.964 INFO:teuthology.orchestra.run.smithi067.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 281 kB/s | 16 kB 00:00 2024-09-13T18:04:48.979 INFO:teuthology.orchestra.run.smithi116.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.6 MB/s | 308 kB 00:00 2024-09-13T18:04:48.997 INFO:teuthology.orchestra.run.smithi067.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 4.4 MB/s | 264 kB 00:00 2024-09-13T18:04:49.005 INFO:teuthology.orchestra.run.smithi116.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:04:49.030 INFO:teuthology.orchestra.run.smithi116.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:04:49.030 INFO:teuthology.orchestra.run.smithi067.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 3.3 MB/s | 226 kB 00:00 2024-09-13T18:04:49.055 INFO:teuthology.orchestra.run.smithi067.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 316 kB/s | 18 kB 00:00 2024-09-13T18:04:49.056 INFO:teuthology.orchestra.run.smithi116.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-13T18:04:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:(6/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 16 MB/s | 18 MB 00:01 2024-09-13T18:04:49.216 INFO:teuthology.orchestra.run.smithi007.stdout:(7/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-09-13T18:04:49.247 INFO:teuthology.orchestra.run.smithi116.stdout:(98/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-13T18:04:49.290 INFO:teuthology.orchestra.run.smithi116.stdout:(99/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-09-13T18:04:49.323 INFO:teuthology.orchestra.run.smithi116.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.6 MB/s | 43 kB 00:00 2024-09-13T18:04:49.327 INFO:teuthology.orchestra.run.smithi007.stdout:(8/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-13T18:04:49.357 INFO:teuthology.orchestra.run.smithi116.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.0 MB/s | 32 kB 00:00 2024-09-13T18:04:49.382 INFO:teuthology.orchestra.run.smithi116.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-13T18:04:49.416 INFO:teuthology.orchestra.run.smithi116.stdout:(103/138): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-13T18:04:49.426 INFO:teuthology.orchestra.run.smithi007.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 257 kB/s | 25 kB 00:00 2024-09-13T18:04:49.441 INFO:teuthology.orchestra.run.smithi116.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-13T18:04:49.483 INFO:teuthology.orchestra.run.smithi116.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-13T18:04:49.514 INFO:teuthology.orchestra.run.smithi067.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 165 kB/s | 80 kB 00:00 2024-09-13T18:04:49.550 INFO:teuthology.orchestra.run.smithi116.stdout:(106/138): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-13T18:04:49.575 INFO:teuthology.orchestra.run.smithi116.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-13T18:04:49.601 INFO:teuthology.orchestra.run.smithi116.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-13T18:04:49.626 INFO:teuthology.orchestra.run.smithi116.stdout:(109/138): python3-google-auth-2.34.0-1.el9.noa 1.2 MB/s | 220 kB 00:00 2024-09-13T18:04:49.651 INFO:teuthology.orchestra.run.smithi116.stdout:(110/138): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-09-13T18:04:49.676 INFO:teuthology.orchestra.run.smithi116.stdout:(111/138): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-09-13T18:04:49.702 INFO:teuthology.orchestra.run.smithi116.stdout:(112/138): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-13T18:04:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:(39/138): libquadmath-11.5.0-2.el9.x86_64.rpm 918 kB/s | 191 kB 00:00 2024-09-13T18:04:49.727 INFO:teuthology.orchestra.run.smithi116.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 920 kB/s | 46 kB 00:00 2024-09-13T18:04:49.752 INFO:teuthology.orchestra.run.smithi116.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-13T18:04:49.769 INFO:teuthology.orchestra.run.smithi116.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-13T18:04:49.795 INFO:teuthology.orchestra.run.smithi116.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-13T18:04:49.819 INFO:teuthology.orchestra.run.smithi116.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-13T18:04:49.831 INFO:teuthology.orchestra.run.smithi067.stdout:(40/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 2.2 MB/s | 7.7 MB 00:03 2024-09-13T18:04:49.853 INFO:teuthology.orchestra.run.smithi116.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-13T18:04:49.868 INFO:teuthology.orchestra.run.smithi007.stdout:(10/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 24 MB/s | 17 MB 00:00 2024-09-13T18:04:49.870 INFO:teuthology.orchestra.run.smithi116.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-13T18:04:49.904 INFO:teuthology.orchestra.run.smithi116.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-13T18:04:49.918 INFO:teuthology.orchestra.run.smithi007.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 4.4 MB/s | 224 kB 00:00 2024-09-13T18:04:49.929 INFO:teuthology.orchestra.run.smithi116.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-13T18:04:49.948 INFO:teuthology.orchestra.run.smithi067.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-13T18:04:49.954 INFO:teuthology.orchestra.run.smithi116.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-13T18:04:49.980 INFO:teuthology.orchestra.run.smithi116.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T18:04:49.990 INFO:teuthology.orchestra.run.smithi067.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 857 kB/s | 801 kB 00:00 2024-09-13T18:04:50.013 INFO:teuthology.orchestra.run.smithi116.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-13T18:04:50.039 INFO:teuthology.orchestra.run.smithi116.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-13T18:04:50.043 INFO:teuthology.orchestra.run.smithi007.stdout:(12/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 9.4 MB/s | 7.7 MB 00:00 2024-09-13T18:04:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-09-13T18:04:50.064 INFO:teuthology.orchestra.run.smithi116.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T18:04:50.085 INFO:teuthology.orchestra.run.smithi007.stdout:(13/138): libcephfs-devel-18.2.4-860.g6c6b083f. 186 kB/s | 31 kB 00:00 2024-09-13T18:04:50.089 INFO:teuthology.orchestra.run.smithi116.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-13T18:04:50.099 INFO:teuthology.orchestra.run.smithi067.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-13T18:04:50.123 INFO:teuthology.orchestra.run.smithi116.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-13T18:04:50.144 INFO:teuthology.orchestra.run.smithi007.stdout:(14/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 7.0 MB/s | 712 kB 00:00 2024-09-13T18:04:50.165 INFO:teuthology.orchestra.run.smithi116.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-13T18:04:50.166 INFO:teuthology.orchestra.run.smithi067.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-13T18:04:50.169 INFO:teuthology.orchestra.run.smithi007.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 1.9 MB/s | 166 kB 00:00 2024-09-13T18:04:50.203 INFO:teuthology.orchestra.run.smithi007.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 2.1 MB/s | 127 kB 00:00 2024-09-13T18:04:50.216 INFO:teuthology.orchestra.run.smithi067.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-13T18:04:50.224 INFO:teuthology.orchestra.run.smithi116.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-13T18:04:50.261 INFO:teuthology.orchestra.run.smithi007.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 5.1 MB/s | 478 kB 00:00 2024-09-13T18:04:50.328 INFO:teuthology.orchestra.run.smithi007.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 678 kB/s | 45 kB 00:00 2024-09-13T18:04:50.357 INFO:teuthology.orchestra.run.smithi116.stdout:(131/138): NetworkManager-1.49.90-1.el9.x86_64. 17 MB/s | 2.3 MB 00:00 2024-09-13T18:04:50.366 INFO:teuthology.orchestra.run.smithi067.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-13T18:04:50.404 INFO:teuthology.orchestra.run.smithi007.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.7 MB/s | 129 kB 00:00 2024-09-13T18:04:50.424 INFO:teuthology.orchestra.run.smithi116.stdout:(132/138): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-13T18:04:50.425 INFO:teuthology.orchestra.run.smithi067.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-13T18:04:50.459 INFO:teuthology.orchestra.run.smithi067.stdout:(49/138): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-13T18:04:50.466 INFO:teuthology.orchestra.run.smithi116.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 980 kB/s | 41 kB 00:00 2024-09-13T18:04:50.470 INFO:teuthology.orchestra.run.smithi007.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.4 MB/s | 162 kB 00:00 2024-09-13T18:04:50.484 INFO:teuthology.orchestra.run.smithi067.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-13T18:04:50.525 INFO:teuthology.orchestra.run.smithi116.stdout:(134/138): librados2-18.2.4-860.g6c6b083f.el9.x 8.2 MB/s | 3.3 MB 00:00 2024-09-13T18:04:50.526 INFO:teuthology.orchestra.run.smithi067.stdout:(51/138): flexiblas-3.0.4-8.el9.x86_64.rpm 785 kB/s | 33 kB 00:00 2024-09-13T18:04:50.537 INFO:teuthology.orchestra.run.smithi007.stdout:(21/138): python3-rados-18.2.4-860.g6c6b083f.el 4.7 MB/s | 321 kB 00:00 2024-09-13T18:04:50.550 INFO:teuthology.orchestra.run.smithi116.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-13T18:04:50.560 INFO:teuthology.orchestra.run.smithi067.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-13T18:04:50.601 INFO:teuthology.orchestra.run.smithi067.stdout:(53/138): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-13T18:04:50.617 INFO:teuthology.orchestra.run.smithi116.stdout:(136/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 36 MB/s | 2.4 MB 00:00 2024-09-13T18:04:50.644 INFO:teuthology.orchestra.run.smithi067.stdout:(54/138): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-13T18:04:50.646 INFO:teuthology.orchestra.run.smithi007.stdout:(22/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 10 MB/s | 4.5 MB 00:00 2024-09-13T18:04:50.680 INFO:teuthology.orchestra.run.smithi007.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 2.1 MB/s | 301 kB 00:00 2024-09-13T18:04:50.705 INFO:teuthology.orchestra.run.smithi007.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T18:04:50.709 INFO:teuthology.orchestra.run.smithi116.stdout:(137/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 5.5 MB/s | 3.0 MB 00:00 2024-09-13T18:04:50.710 INFO:teuthology.orchestra.run.smithi067.stdout:(55/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-13T18:04:50.731 INFO:teuthology.orchestra.run.smithi007.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.7 MB/s | 87 kB 00:00 2024-09-13T18:04:50.751 INFO:teuthology.orchestra.run.smithi116.stdout:(138/138): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-13T18:04:50.752 INFO:teuthology.orchestra.run.smithi067.stdout:(56/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-13T18:04:50.757 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:04:50.758 INFO:teuthology.orchestra.run.smithi116.stdout:Total 26 MB/s | 203 MB 00:07 2024-09-13T18:04:50.781 INFO:teuthology.orchestra.run.smithi007.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 3.4 MB/s | 172 kB 00:00 2024-09-13T18:04:50.831 INFO:teuthology.orchestra.run.smithi007.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 494 kB/s | 24 kB 00:00 2024-09-13T18:04:50.836 INFO:teuthology.orchestra.run.smithi067.stdout:(57/138): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-13T18:04:50.940 INFO:teuthology.orchestra.run.smithi007.stdout:(28/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 13 MB/s | 3.0 MB 00:00 2024-09-13T18:04:50.973 INFO:teuthology.orchestra.run.smithi007.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 983 kB/s | 139 kB 00:00 2024-09-13T18:04:50.986 INFO:teuthology.orchestra.run.smithi067.stdout:(58/138): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-13T18:04:51.011 INFO:teuthology.orchestra.run.smithi067.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-09-13T18:04:51.037 INFO:teuthology.orchestra.run.smithi067.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 486 kB/s | 24 kB 00:00 2024-09-13T18:04:51.062 INFO:teuthology.orchestra.run.smithi067.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-13T18:04:51.087 INFO:teuthology.orchestra.run.smithi067.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-13T18:04:51.112 INFO:teuthology.orchestra.run.smithi067.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-13T18:04:51.338 INFO:teuthology.orchestra.run.smithi067.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-09-13T18:04:51.582 INFO:teuthology.orchestra.run.smithi007.stdout:(30/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 18 MB/s | 40 MB 00:02 2024-09-13T18:04:51.674 INFO:teuthology.orchestra.run.smithi007.stdout:(31/138): ceph-mgr-diskprediction-local-18.2.4- 11 MB/s | 7.4 MB 00:00 2024-09-13T18:04:51.700 INFO:teuthology.orchestra.run.smithi007.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 2.1 MB/s | 246 kB 00:00 2024-09-13T18:04:51.725 INFO:teuthology.orchestra.run.smithi007.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 984 kB/s | 49 kB 00:00 2024-09-13T18:04:51.750 INFO:teuthology.orchestra.run.smithi007.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 327 kB/s | 16 kB 00:00 2024-09-13T18:04:51.771 INFO:teuthology.orchestra.run.smithi067.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-13T18:04:51.775 INFO:teuthology.orchestra.run.smithi007.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 5.1 MB/s | 264 kB 00:00 2024-09-13T18:04:51.812 INFO:teuthology.orchestra.run.smithi007.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 3.8 MB/s | 226 kB 00:00 2024-09-13T18:04:51.828 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-13T18:04:51.834 INFO:teuthology.orchestra.run.smithi007.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 310 kB/s | 18 kB 00:00 2024-09-13T18:04:51.911 INFO:teuthology.orchestra.run.smithi007.stdout:(38/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 3.6 MB/s | 3.5 MB 00:00 2024-09-13T18:04:51.971 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-13T18:04:51.971 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-13T18:04:52.030 INFO:teuthology.orchestra.run.smithi067.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-13T18:04:52.052 INFO:teuthology.orchestra.run.smithi007.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-13T18:04:52.097 INFO:teuthology.orchestra.run.smithi067.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-13T18:04:52.135 INFO:teuthology.orchestra.run.smithi007.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 854 kB/s | 191 kB 00:00 2024-09-13T18:04:52.177 INFO:teuthology.orchestra.run.smithi007.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-13T18:04:52.211 INFO:teuthology.orchestra.run.smithi007.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-13T18:04:52.236 INFO:teuthology.orchestra.run.smithi007.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T18:04:52.265 INFO:teuthology.orchestra.run.smithi007.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-13T18:04:52.295 INFO:teuthology.orchestra.run.smithi007.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-13T18:04:52.320 INFO:teuthology.orchestra.run.smithi007.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-13T18:04:52.363 INFO:teuthology.orchestra.run.smithi007.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-13T18:04:52.381 INFO:teuthology.orchestra.run.smithi067.stdout:(68/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-09-13T18:04:52.454 INFO:teuthology.orchestra.run.smithi007.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-13T18:04:52.480 INFO:teuthology.orchestra.run.smithi007.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 915 kB/s | 107 kB 00:00 2024-09-13T18:04:52.496 INFO:teuthology.orchestra.run.smithi007.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 517 kB/s | 22 kB 00:00 2024-09-13T18:04:52.530 INFO:teuthology.orchestra.run.smithi007.stdout:(51/138): flexiblas-3.0.4-8.el9.x86_64.rpm 982 kB/s | 33 kB 00:00 2024-09-13T18:04:52.531 INFO:teuthology.orchestra.run.smithi067.stdout:(69/138): openblas-openmp-0.3.26-2.el9.x86_64.r 3.4 MB/s | 4.9 MB 00:01 2024-09-13T18:04:52.556 INFO:teuthology.orchestra.run.smithi007.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-13T18:04:52.589 INFO:teuthology.orchestra.run.smithi007.stdout:(53/138): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-13T18:04:52.614 INFO:teuthology.orchestra.run.smithi007.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-13T18:04:52.615 INFO:teuthology.orchestra.run.smithi067.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-13T18:04:52.640 INFO:teuthology.orchestra.run.smithi007.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-13T18:04:52.682 INFO:teuthology.orchestra.run.smithi007.stdout:(56/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-13T18:04:52.698 INFO:teuthology.orchestra.run.smithi067.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-13T18:04:52.707 INFO:teuthology.orchestra.run.smithi007.stdout:(57/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-13T18:04:52.740 INFO:teuthology.orchestra.run.smithi067.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 618 kB/s | 26 kB 00:00 2024-09-13T18:04:52.782 INFO:teuthology.orchestra.run.smithi067.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-13T18:04:52.790 INFO:teuthology.orchestra.run.smithi007.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-13T18:04:52.833 INFO:teuthology.orchestra.run.smithi007.stdout:(59/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 587 kB/s | 24 kB 00:00 2024-09-13T18:04:52.849 INFO:teuthology.orchestra.run.smithi067.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-13T18:04:52.891 INFO:teuthology.orchestra.run.smithi067.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-13T18:04:52.891 INFO:teuthology.orchestra.run.smithi007.stdout:(60/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 815 kB/s | 47 kB 00:00 2024-09-13T18:04:52.916 INFO:teuthology.orchestra.run.smithi007.stdout:(61/138): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-13T18:04:52.984 INFO:teuthology.orchestra.run.smithi007.stdout:(62/138): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-13T18:04:53.009 INFO:teuthology.orchestra.run.smithi007.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-13T18:04:53.459 INFO:teuthology.orchestra.run.smithi007.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-09-13T18:04:53.607 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-13T18:04:53.608 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-13T18:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout:(76/138): postgresql-server-13.16-1.el9.x86_64. 3.3 MB/s | 5.8 MB 00:01 2024-09-13T18:04:53.893 INFO:teuthology.orchestra.run.smithi007.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-13T18:04:53.933 INFO:teuthology.orchestra.run.smithi067.stdout:(77/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-13T18:04:54.058 INFO:teuthology.orchestra.run.smithi067.stdout:(78/138): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2024-09-13T18:04:54.092 INFO:teuthology.orchestra.run.smithi067.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-13T18:04:54.110 INFO:teuthology.orchestra.run.smithi007.stdout:(66/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-13T18:04:54.134 INFO:teuthology.orchestra.run.smithi067.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-13T18:04:54.159 INFO:teuthology.orchestra.run.smithi067.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-09-13T18:04:54.202 INFO:teuthology.orchestra.run.smithi007.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 2.9 MB/s | 910 kB 00:00 2024-09-13T18:04:54.218 INFO:teuthology.orchestra.run.smithi067.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-13T18:04:54.227 INFO:teuthology.orchestra.run.smithi007.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-13T18:04:54.260 INFO:teuthology.orchestra.run.smithi067.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-13T18:04:54.343 INFO:teuthology.orchestra.run.smithi067.stdout:(84/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.5 MB/s | 5.1 MB 00:01 2024-09-13T18:04:54.377 INFO:teuthology.orchestra.run.smithi067.stdout:(85/138): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-09-13T18:04:54.402 INFO:teuthology.orchestra.run.smithi067.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 377 kB/s | 54 kB 00:00 2024-09-13T18:04:54.427 INFO:teuthology.orchestra.run.smithi067.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-13T18:04:54.469 INFO:teuthology.orchestra.run.smithi007.stdout:(69/138): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-09-13T18:04:54.470 INFO:teuthology.orchestra.run.smithi067.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-13T18:04:54.528 INFO:teuthology.orchestra.run.smithi067.stdout:(89/138): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-13T18:04:54.561 INFO:teuthology.orchestra.run.smithi007.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-13T18:04:54.561 INFO:teuthology.orchestra.run.smithi067.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-09-13T18:04:54.604 INFO:teuthology.orchestra.run.smithi067.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-09-13T18:04:54.646 INFO:teuthology.orchestra.run.smithi067.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-09-13T18:04:54.653 INFO:teuthology.orchestra.run.smithi007.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-09-13T18:04:54.696 INFO:teuthology.orchestra.run.smithi067.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.2 MB/s | 111 kB 00:00 2024-09-13T18:04:54.712 INFO:teuthology.orchestra.run.smithi007.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-09-13T18:04:54.755 INFO:teuthology.orchestra.run.smithi067.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.8 MB/s | 308 kB 00:00 2024-09-13T18:04:54.770 INFO:teuthology.orchestra.run.smithi007.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-09-13T18:04:54.780 INFO:teuthology.orchestra.run.smithi067.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:04:54.805 INFO:teuthology.orchestra.run.smithi067.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:04:54.839 INFO:teuthology.orchestra.run.smithi067.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T18:04:54.845 INFO:teuthology.orchestra.run.smithi007.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2024-09-13T18:04:54.905 INFO:teuthology.orchestra.run.smithi007.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-09-13T18:04:54.931 INFO:teuthology.orchestra.run.smithi067.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 839 kB 00:00 2024-09-13T18:04:55.006 INFO:teuthology.orchestra.run.smithi067.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 7.1 MB/s | 548 kB 00:00 2024-09-13T18:04:55.031 INFO:teuthology.orchestra.run.smithi067.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T18:04:55.056 INFO:teuthology.orchestra.run.smithi067.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T18:04:55.082 INFO:teuthology.orchestra.run.smithi067.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-13T18:04:55.115 INFO:teuthology.orchestra.run.smithi067.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-13T18:04:55.166 INFO:teuthology.orchestra.run.smithi067.stdout:(104/138): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-13T18:04:55.224 INFO:teuthology.orchestra.run.smithi067.stdout:(105/138): libarrow-9.0.0-11.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-09-13T18:04:55.249 INFO:teuthology.orchestra.run.smithi067.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-13T18:04:55.275 INFO:teuthology.orchestra.run.smithi067.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-13T18:04:55.300 INFO:teuthology.orchestra.run.smithi067.stdout:(108/138): python3-google-auth-2.34.0-1.el9.noa 1.6 MB/s | 220 kB 00:00 2024-09-13T18:04:55.326 INFO:teuthology.orchestra.run.smithi067.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 457 kB/s | 23 kB 00:00 2024-09-13T18:04:55.351 INFO:teuthology.orchestra.run.smithi067.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-13T18:04:55.376 INFO:teuthology.orchestra.run.smithi067.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-13T18:04:55.388 INFO:teuthology.orchestra.run.smithi007.stdout:(76/138): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-09-13T18:04:55.401 INFO:teuthology.orchestra.run.smithi067.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T18:04:55.426 INFO:teuthology.orchestra.run.smithi067.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T18:04:55.430 INFO:teuthology.orchestra.run.smithi007.stdout:(77/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-13T18:04:55.469 INFO:teuthology.orchestra.run.smithi067.stdout:(114/138): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-13T18:04:55.489 INFO:teuthology.orchestra.run.smithi007.stdout:(78/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-13T18:04:55.494 INFO:teuthology.orchestra.run.smithi067.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-13T18:04:55.519 INFO:teuthology.orchestra.run.smithi067.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-13T18:04:55.530 INFO:teuthology.orchestra.run.smithi007.stdout:(79/138): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-13T18:04:55.544 INFO:teuthology.orchestra.run.smithi067.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-13T18:04:55.570 INFO:teuthology.orchestra.run.smithi067.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T18:04:55.595 INFO:teuthology.orchestra.run.smithi067.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-13T18:04:55.597 INFO:teuthology.orchestra.run.smithi007.stdout:(80/138): python3-prettytable-0.7.2-27.el9.noar 634 kB/s | 42 kB 00:00 2024-09-13T18:04:55.620 INFO:teuthology.orchestra.run.smithi067.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-13T18:04:55.639 INFO:teuthology.orchestra.run.smithi007.stdout:(81/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-13T18:04:55.645 INFO:teuthology.orchestra.run.smithi067.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-13T18:04:55.671 INFO:teuthology.orchestra.run.smithi067.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-13T18:04:55.681 INFO:teuthology.orchestra.run.smithi007.stdout:(82/138): python3-pyasn1-modules-0.4.8-6.el9.no 6.6 MB/s | 279 kB 00:00 2024-09-13T18:04:55.696 INFO:teuthology.orchestra.run.smithi067.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-13T18:04:55.721 INFO:teuthology.orchestra.run.smithi067.stdout:(124/138): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-13T18:04:55.747 INFO:teuthology.orchestra.run.smithi067.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-13T18:04:55.748 INFO:teuthology.orchestra.run.smithi007.stdout:(83/138): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-09-13T18:04:55.763 INFO:teuthology.orchestra.run.smithi067.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-13T18:04:55.789 INFO:teuthology.orchestra.run.smithi067.stdout:(127/138): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-09-13T18:04:55.814 INFO:teuthology.orchestra.run.smithi067.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T18:04:55.815 INFO:teuthology.orchestra.run.smithi007.stdout:(84/138): python3-requests-oauthlib-1.3.0-12.el 806 kB/s | 54 kB 00:00 2024-09-13T18:04:55.873 INFO:teuthology.orchestra.run.smithi067.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-13T18:04:56.065 INFO:teuthology.orchestra.run.smithi067.stdout:(130/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.4 MB/s | 16 MB 00:01 2024-09-13T18:04:56.182 INFO:teuthology.orchestra.run.smithi067.stdout:(131/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 9.8 MB/s | 3.0 MB 00:00 2024-09-13T18:04:56.207 INFO:teuthology.orchestra.run.smithi007.stdout:(85/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-13T18:04:56.249 INFO:teuthology.orchestra.run.smithi007.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-13T18:04:56.300 INFO:teuthology.orchestra.run.smithi007.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-13T18:04:56.342 INFO:teuthology.orchestra.run.smithi007.stdout:(88/138): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-13T18:04:56.384 INFO:teuthology.orchestra.run.smithi007.stdout:(89/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 2.2 MB/s | 96 kB 00:00 2024-09-13T18:04:56.426 INFO:teuthology.orchestra.run.smithi007.stdout:(90/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-13T18:04:56.534 INFO:teuthology.orchestra.run.smithi007.stdout:(91/138): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-09-13T18:04:56.549 INFO:teuthology.orchestra.run.smithi067.stdout:(132/138): librados2-18.2.4-860.g6c6b083f.el9.x 4.5 MB/s | 3.3 MB 00:00 2024-09-13T18:04:56.559 INFO:teuthology.orchestra.run.smithi007.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 336 kB/s | 45 kB 00:00 2024-09-13T18:04:56.660 INFO:teuthology.orchestra.run.smithi007.stdout:(93/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-13T18:04:56.702 INFO:teuthology.orchestra.run.smithi007.stdout:(94/138): fmt-8.1.1-5.el9.x86_64.rpm 662 kB/s | 111 kB 00:00 2024-09-13T18:04:56.727 INFO:teuthology.orchestra.run.smithi007.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T18:04:56.752 INFO:teuthology.orchestra.run.smithi007.stdout:(96/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 1.6 MB/s | 308 kB 00:00 2024-09-13T18:04:56.773 INFO:teuthology.orchestra.run.smithi007.stdout:(97/138): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-13T18:04:56.798 INFO:teuthology.orchestra.run.smithi007.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2024-09-13T18:04:56.832 INFO:teuthology.orchestra.run.smithi067.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 144 kB/s | 41 kB 00:00 2024-09-13T18:04:56.911 INFO:teuthology.orchestra.run.smithi007.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 4.8 MB/s | 548 kB 00:00 2024-09-13T18:04:56.941 INFO:teuthology.orchestra.run.smithi007.stdout:(100/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-13T18:04:56.965 INFO:teuthology.orchestra.run.smithi007.stdout:(101/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 801 kB/s | 43 kB 00:00 2024-09-13T18:04:56.982 INFO:teuthology.orchestra.run.smithi007.stdout:(102/138): python3-cachetools-4.2.4-1.el9.noarc 771 kB/s | 32 kB 00:00 2024-09-13T18:04:56.999 INFO:teuthology.orchestra.run.smithi007.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 421 kB/s | 14 kB 00:00 2024-09-13T18:04:57.033 INFO:teuthology.orchestra.run.smithi007.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-13T18:04:57.075 INFO:teuthology.orchestra.run.smithi007.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-13T18:04:57.100 INFO:teuthology.orchestra.run.smithi007.stdout:(106/138): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-13T18:04:57.107 INFO:teuthology.orchestra.run.smithi067.stdout:(134/138): NetworkManager-libnm-1.49.90-1.el9.x 1.9 MB/s | 1.8 MB 00:00 2024-09-13T18:04:57.125 INFO:teuthology.orchestra.run.smithi007.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-13T18:04:57.151 INFO:teuthology.orchestra.run.smithi007.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 350 kB/s | 18 kB 00:00 2024-09-13T18:04:57.176 INFO:teuthology.orchestra.run.smithi007.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 458 kB/s | 23 kB 00:00 2024-09-13T18:04:57.202 INFO:teuthology.orchestra.run.smithi007.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-13T18:04:57.208 INFO:teuthology.orchestra.run.smithi067.stdout:(135/138): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-13T18:04:57.227 INFO:teuthology.orchestra.run.smithi007.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-13T18:04:57.253 INFO:teuthology.orchestra.run.smithi007.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T18:04:57.286 INFO:teuthology.orchestra.run.smithi007.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T18:04:57.320 INFO:teuthology.orchestra.run.smithi007.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-13T18:04:57.325 INFO:teuthology.orchestra.run.smithi067.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 1.4 MB 00:00 2024-09-13T18:04:57.350 INFO:teuthology.orchestra.run.smithi067.stdout:(137/138): NetworkManager-tui-1.49.90-1.el9.x86 481 kB/s | 249 kB 00:00 2024-09-13T18:04:57.362 INFO:teuthology.orchestra.run.smithi007.stdout:(115/138): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-13T18:04:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-13T18:04:57.421 INFO:teuthology.orchestra.run.smithi007.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-13T18:04:57.446 INFO:teuthology.orchestra.run.smithi007.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-13T18:04:57.471 INFO:teuthology.orchestra.run.smithi007.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-13T18:04:57.497 INFO:teuthology.orchestra.run.smithi007.stdout:(120/138): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-13T18:04:57.522 INFO:teuthology.orchestra.run.smithi007.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T18:04:57.547 INFO:teuthology.orchestra.run.smithi007.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-13T18:04:57.572 INFO:teuthology.orchestra.run.smithi007.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T18:04:57.598 INFO:teuthology.orchestra.run.smithi007.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T18:04:57.623 INFO:teuthology.orchestra.run.smithi007.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T18:04:57.648 INFO:teuthology.orchestra.run.smithi007.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2024-09-13T18:04:57.682 INFO:teuthology.orchestra.run.smithi007.stdout:(127/138): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-13T18:04:57.766 INFO:teuthology.orchestra.run.smithi007.stdout:(128/138): libarrow-9.0.0-11.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-13T18:04:57.791 INFO:teuthology.orchestra.run.smithi007.stdout:(129/138): re2-20211101-20.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-13T18:04:57.849 INFO:teuthology.orchestra.run.smithi007.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-13T18:04:58.058 INFO:teuthology.orchestra.run.smithi007.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 11 MB/s | 3.3 MB 00:00 2024-09-13T18:04:58.125 INFO:teuthology.orchestra.run.smithi007.stdout:(132/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 9.0 MB/s | 3.0 MB 00:00 2024-09-13T18:04:58.242 INFO:teuthology.orchestra.run.smithi007.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 350 kB/s | 41 kB 00:00 2024-09-13T18:04:58.326 INFO:teuthology.orchestra.run.smithi007.stdout:(134/138): NetworkManager-1.49.90-1.el9.x86_64. 4.9 MB/s | 2.3 MB 00:00 2024-09-13T18:04:58.401 INFO:teuthology.orchestra.run.smithi007.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 1.5 MB/s | 249 kB 00:00 2024-09-13T18:04:58.435 INFO:teuthology.orchestra.run.smithi007.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-13T18:04:58.535 INFO:teuthology.orchestra.run.smithi007.stdout:(137/138): NetworkManager-libnm-1.49.90-1.el9.x 3.8 MB/s | 1.8 MB 00:00 2024-09-13T18:04:58.675 INFO:teuthology.orchestra.run.smithi067.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 2.4 MB 00:01 2024-09-13T18:04:58.680 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:04:58.680 INFO:teuthology.orchestra.run.smithi067.stdout:Total 13 MB/s | 203 MB 00:15 2024-09-13T18:04:59.135 INFO:teuthology.orchestra.run.smithi007.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-13T18:04:59.143 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:04:59.143 INFO:teuthology.orchestra.run.smithi007.stdout:Total 18 MB/s | 203 MB 00:11 2024-09-13T18:04:59.227 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-13T18:04:59.321 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:04:59.359 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:04:59.421 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:04:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:04:59.480 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:04:59.531 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:04:59.812 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-13T18:04:59.860 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:04:59.970 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-13T18:04:59.970 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-13T18:04:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:00.099 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:00.190 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:00.220 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:05:00.368 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:05:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:05:00.453 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:00.554 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:00.579 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:05:00.762 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:05:00.876 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:05:00.975 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-13T18:05:00.978 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:01.052 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:01.163 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-13T18:05:01.164 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-13T18:05:01.339 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:01.373 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:05:01.408 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:05:01.482 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:05:01.515 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:05:01.551 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:05:01.621 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:05:01.682 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:05:01.700 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-13T18:05:01.700 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-13T18:05:01.712 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:05:01.748 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:05:01.823 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:05:01.859 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:05:01.902 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:05:01.975 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:05:02.116 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:05:02.165 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:05:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:05:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:05:02.816 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:05:02.853 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:05:02.894 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:05:03.055 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:05:03.112 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:05:03.218 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:05:03.257 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:05:03.312 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:05:03.384 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:05:03.417 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:05:03.440 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-13T18:05:03.440 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-13T18:05:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:05:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:05:03.554 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:05:03.604 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:05:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:05:03.781 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:05:03.822 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:05:03.923 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:05:03.981 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:05:04.029 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:05:04.054 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:05:04.082 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:05:04.123 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:05:04.151 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:05:04.186 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:05:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:05:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:05:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:05:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:05:04.362 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:05:04.396 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:05:04.440 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:05:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:05:04.602 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:05:04.649 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:05:05.368 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:05:05.422 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:05:05.457 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:05:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:05:05.608 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:05:05.791 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:05:05.822 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:05:05.900 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:05:06.540 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:05:06.662 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:05:07.371 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-13T18:05:07.479 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:05:07.602 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:05:07.800 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:05:07.839 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:05:07.872 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:05:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:05:07.926 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:05:07.951 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:05:07.979 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:05:08.012 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:05:08.261 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:05:08.314 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:05:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:05:08.372 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:08.441 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:05:08.480 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:05:08.524 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:05:08.526 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:08.557 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:08.650 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:08.687 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:05:08.844 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:05:08.896 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:05:08.930 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:05:08.961 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:05:09.032 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:05:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:05:09.111 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:09.223 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:09.245 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:05:09.408 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:05:09.525 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:05:09.628 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:09.748 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-13T18:05:09.907 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:05:09.973 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:05:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:10.041 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:05:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:05:10.084 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:05:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:05:10.116 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:05:10.176 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:05:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:05:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:05:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:05:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:05:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:05:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:05:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:05:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:05:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:05:10.574 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:05:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:05:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:05:10.683 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:05:10.871 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:05:10.909 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:11.059 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:11.098 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:05:11.107 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:11.142 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:11.316 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:05:11.380 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:05:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:11.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:05:11.538 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:05:11.564 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:11.590 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:05:11.591 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:05:11.629 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:05:11.664 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:11.670 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:05:11.704 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:05:11.800 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:05:11.801 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:05:11.801 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:05:11.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:11.822 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:05:11.830 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:05:11.848 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:05:11.929 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:05:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:05:12.039 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:05:12.074 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:05:12.130 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:05:12.172 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:12.205 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:05:12.250 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:05:12.263 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:12.287 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:05:12.335 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:05:12.379 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:05:12.421 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:05:12.572 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:05:12.622 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:05:12.624 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:05:12.660 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:05:12.663 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:05:12.731 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:05:12.772 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:05:12.805 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:05:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:05:12.845 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:05:12.871 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:05:12.878 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:05:12.904 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:05:12.905 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:05:12.938 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:05:12.983 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:05:12.997 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:05:13.066 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:05:13.099 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:05:13.147 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:05:13.244 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:05:13.246 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:05:13.282 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:05:13.287 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:05:13.310 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:05:13.332 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:05:13.345 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:05:13.378 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:05:13.421 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:05:13.421 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:05:13.454 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:05:13.489 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:05:13.542 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:05:13.592 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:05:13.653 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:05:13.655 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:05:13.717 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:05:14.327 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:05:14.465 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:05:14.483 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:05:14.518 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:05:14.536 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:05:14.556 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:05:14.570 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:05:14.609 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:05:14.675 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:05:14.712 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:05:14.814 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:05:14.873 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:05:14.903 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:05:14.935 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:05:15.012 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:05:15.014 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:05:15.060 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:05:15.503 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:05:15.553 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:05:15.590 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:05:15.670 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:05:15.706 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:05:15.819 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:05:16.035 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:05:16.085 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:05:16.263 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:05:16.308 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:05:16.352 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:05:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:05:16.534 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:05:16.585 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:05:16.620 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:05:16.645 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:05:16.678 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:05:16.725 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:05:16.776 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:05:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:05:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:05:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:05:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:05:16.962 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:05:17.019 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:05:17.055 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:05:17.106 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:05:17.122 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:05:17.196 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:05:17.224 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:05:17.233 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:05:17.257 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:05:17.302 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:05:17.572 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:05:17.612 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:05:17.703 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:05:17.733 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:05:17.778 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:05:18.212 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:05:18.238 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:05:18.239 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:05:18.294 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:05:18.296 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:05:18.324 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:05:18.329 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:05:18.449 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:05:18.496 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:05:18.745 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:05:18.777 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:05:18.884 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:05:19.748 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:05:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:05:20.445 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:20.489 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:21.042 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:21.084 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:05:21.192 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:05:21.193 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:05:21.193 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:05:21.193 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:21.227 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:05:21.546 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:05:21.646 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:05:21.690 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:05:21.732 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:05:22.083 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:05:22.126 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:05:22.273 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:05:22.350 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:05:22.416 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:05:22.887 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:05:22.923 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:05:23.064 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:05:23.091 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:05:23.167 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:05:23.167 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-09-13T18:05:23.168 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-09-13T18:05:23.168 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-09-13T18:05:23.168 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-09-13T18:05:23.168 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-09-13T18:05:23.168 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-09-13T18:05:23.168 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-09-13T18:05:23.168 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:23.331 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:05:23.346 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:05:23.347 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:23.347 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:05:23.347 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:24.792 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:05:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:05:24.819 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:24.819 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:05:24.819 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:05:24.819 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:05:24.819 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:25.043 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:05:25.067 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:05:25.067 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:25.067 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:05:25.067 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:05:25.067 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:05:25.067 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:25.520 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:05:25.543 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:05:25.543 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:25.543 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:05:25.544 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:05:25.544 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:05:25.544 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:25.649 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:05:25.698 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:05:25.725 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:25.761 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:05:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:25.944 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:05:26.003 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:05:26.072 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:05:26.169 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:05:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:05:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:05:26.394 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:05:26.408 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:05:26.422 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:05:26.450 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:05:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:05:26.562 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:05:26.562 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:05:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:26.609 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:05:26.836 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:05:26.865 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:05:26.937 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:05:26.960 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:05:27.987 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:05:28.020 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:05:28.976 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:05:29.003 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:05:29.104 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:05:29.259 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:05:29.297 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:05:29.321 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:05:29.321 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:29.321 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:05:29.321 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:05:29.321 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:05:29.321 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:29.381 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:05:29.393 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:05:29.486 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:05:29.537 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:05:30.250 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:05:30.284 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:05:30.307 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:05:30.307 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:30.307 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:05:30.307 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:05:30.307 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:05:30.308 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:30.351 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:05:30.374 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:05:30.374 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:30.374 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:05:30.374 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:30.418 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:05:30.441 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:05:30.441 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:30.441 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:05:30.442 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:05:30.442 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:05:30.442 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:30.736 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:05:30.759 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:05:30.759 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:30.759 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:05:30.759 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:05:30.759 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:05:30.759 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-09-13T18:05:33.123 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-09-13T18:05:33.124 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:33.302 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:05:33.319 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:05:33.319 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:33.320 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:05:33.320 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:05:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:05:34.579 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:05:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:05:34.789 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:05:34.822 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:05:34.843 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:05:34.849 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:05:34.849 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:34.849 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:05:34.849 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:05:34.849 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:05:34.850 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:34.873 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:05:34.903 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:05:34.949 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:05:35.065 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:05:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:05:35.088 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:35.088 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:05:35.088 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:05:35.088 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:05:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:35.535 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:35.548 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:05:35.572 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:05:35.572 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:35.572 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:05:35.572 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:05:35.573 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:05:35.573 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:35.573 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:35.593 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:35.688 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:05:35.754 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:05:35.818 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:05:36.020 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:05:36.075 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:05:36.155 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:05:36.261 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:05:36.412 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:05:36.429 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:05:36.458 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:05:36.490 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:05:36.517 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:05:36.552 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:05:36.593 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:05:36.674 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:05:36.705 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:05:36.755 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:05:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:05:36.781 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:05:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:05:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:05:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:05:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:05:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:36.949 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:05:36.974 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:05:37.003 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:05:37.068 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:05:37.097 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:05:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:05:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:05:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:38.196 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:05:38.232 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:05:39.245 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:05:39.282 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:05:39.389 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:05:39.389 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-09-13T18:05:39.389 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-09-13T18:05:39.390 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-09-13T18:05:39.390 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-09-13T18:05:39.390 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-09-13T18:05:39.390 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-09-13T18:05:39.390 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-09-13T18:05:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:39.390 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:05:39.554 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:05:39.584 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:05:39.609 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:05:39.609 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:39.609 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:05:39.609 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:05:39.609 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:05:39.610 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:39.612 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:05:39.649 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:05:39.649 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:39.649 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:05:39.649 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:39.660 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:05:39.672 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:05:39.769 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:05:39.827 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:05:40.578 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:05:40.604 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:40.629 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:05:40.629 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:05:40.629 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:05:40.629 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:40.671 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:05:40.695 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:05:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:40.695 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:05:40.695 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:40.747 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:05:40.770 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:05:40.770 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:40.770 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:05:40.771 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:05:40.771 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:05:40.771 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:41.089 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:05:41.113 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:05:41.113 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:41.113 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:05:41.113 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:05:41.113 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:05:41.113 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:41.316 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:05:41.373 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:05:41.373 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:41.373 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:05:41.374 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:05:41.374 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:05:41.374 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:41.608 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:05:41.659 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:05:41.659 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:41.660 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:05:41.660 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:05:41.660 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:05:41.660 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:42.167 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:05:42.218 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:05:42.218 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:42.218 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:05:42.218 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:05:42.218 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:05:42.218 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:42.359 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:05:42.421 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:05:42.499 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:05:42.510 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:42.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:05:42.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:05:42.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:05:42.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:05:42.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:05:42.514 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:05:42.515 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:05:42.516 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:05:42.517 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:05:42.518 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:05:42.519 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:05:42.520 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:05:42.521 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:05:42.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:05:42.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:05:42.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:05:42.522 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:05:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:05:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:05:42.893 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:05:43.030 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:05:43.208 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:05:43.256 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:05:43.303 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:05:43.336 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:05:43.888 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:05:43.919 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:05:43.949 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:05:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:05:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:05:44.993 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:05:45.035 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:05:45.076 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:05:45.107 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:45.127 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.128 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:05:45.130 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.131 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:05:45.132 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:05:45.133 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:05:45.134 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:05:45.135 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:05:45.136 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:05:45.137 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:05:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:05:45.138 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:05:45.138 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-13T18:05:45.296 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:05:45.341 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:05:45.388 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:05:45.393 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:05:45.418 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:05:45.448 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:05:45.503 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:05:45.550 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:46.138 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:46.184 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:46.205 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:46.550 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:05:46.586 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:05:46.728 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:05:46.919 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:05:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:05:46.997 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:05:46.997 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:46.998 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:05:46.998 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:05:46.998 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:05:46.998 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:47.055 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:05:47.081 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:05:47.117 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:05:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:05:47.205 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:05:47.256 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:05:47.262 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:05:47.349 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:05:47.383 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:05:47.408 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:05:47.434 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:05:47.434 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:05:47.519 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:05:47.519 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:05:47.603 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:05:47.628 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:05:47.633 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:47.633 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:47.821 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:47.821 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:05:47.905 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:05:47.979 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:05:48.116 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:05:48.167 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:05:48.168 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:48.168 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:05:48.168 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:05:48.168 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:05:48.168 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:48.216 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:05:48.266 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:05:48.267 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:48.267 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:05:48.267 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:48.326 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:05:48.377 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:05:48.377 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:48.377 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:05:48.377 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:05:48.378 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:05:48.378 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:05:53.007 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:05:53.057 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:05:53.094 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:53.094 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:05:53.094 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:05:53.094 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:05:53.094 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:05:53.095 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:05:53.096 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:05:53.103 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:05:53.107 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:05:53.108 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:05:53.109 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:05:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:05:53.111 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:05:53.112 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:05:53.113 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:05:53.114 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:05:53.115 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:05:53.116 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:05:53.116 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:05:53.116 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:05:53.116 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:05:53.137 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:05:53.393 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:05:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:05:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:05:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:05:54.292 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:54.339 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:54.381 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:05:55.736 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:55.736 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:55.736 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-09-13T18:05:55.737 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:55.737 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:55.737 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:55.737 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:05:55.737 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.740 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.740 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:05:55.740 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:05:55.740 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-13T18:05:55.740 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.741 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.742 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:05:55.743 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:05:55.744 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:05:55.745 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:05:55.746 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:05:55.747 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:05:55.748 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:05:55.749 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:05:55.749 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:05:55.749 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:05:55.749 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:05:55.749 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:05:55.749 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:05:55.750 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:05:55.751 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:05:55.752 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:05:55.752 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:05:55.752 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-13T18:05:55.752 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-13T18:05:55.863 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:05:56.031 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:05:56.074 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:05:56.125 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:56.152 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:05:56.152 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:05:56.285 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:05:56.285 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:05:56.393 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:05:56.418 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:05:56.434 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:56.435 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:56.687 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:05:56.687 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:05:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:05:56.873 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:57.084 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:05:57.084 INFO:teuthology.orchestra.run.smithi007.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T18:05:57.084 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:06:02.396 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:06:02.397 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:06:02.398 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:06:02.399 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:06:02.400 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:06:02.400 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:06:02.400 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:06:02.400 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:06:02.401 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:06:02.402 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:06:02.403 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:06:02.404 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:06:02.405 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:06:02.406 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:06:02.407 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:06:02.408 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:06:02.408 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:06:02.408 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:06:02.408 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:06:02.408 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:06:02.408 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:06:04.680 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:06:04.681 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.682 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:06:04.683 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:06:04.684 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:06:04.685 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.686 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:06:04.687 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:06:04.688 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.690 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:06:04.691 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:06:04.692 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-13T18:06:05.329 DEBUG:teuthology.parallel:result is None 2024-09-13T18:06:05.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:06:05.490 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:06:05.534 INFO:teuthology.orchestra.run.smithi007.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:06:05.535 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:06:05.536 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:06:05.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:06:05.689 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:06:05.716 INFO:teuthology.orchestra.run.smithi067.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:06:05.716 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:06:05.716 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:06:05.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:06:05.871 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:06:05.898 INFO:teuthology.orchestra.run.smithi116.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:06:05.898 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:06:05.898 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:06:05.900 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:06:05.900 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:06:05.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:06:05.964 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:06:05.964 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:06:05.997 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:06:05.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:06:06.028 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:06:06.028 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:06:06.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:06:06.086 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:06:06.186 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:06:06.186 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:06:06.215 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:06:06.284 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:06:06.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:06:06.315 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:06:06.385 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:06:06.385 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:06:06.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:06:06.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:06:06.546 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:06:06.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:06:06.575 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:06:06.645 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:06:06.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:06:06.670 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:06:06.736 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:06:06.736 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:06:06.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:06:06.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:06:06.895 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:06:06.895 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:06:06.925 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:06:06.994 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:06:06.994 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:06:07.019 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:06:07.083 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T18:06:07.182 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-13T18:06:07.182 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:06:07.183 INFO:tasks.cephadm:Cluster fsid is d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:06:07.183 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T18:06:07.183 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.b': '172.21.15.67', 'mon.c': '172.21.15.116'} 2024-09-13T18:06:07.183 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-09-13T18:06:07.183 INFO:tasks.cephadm:First mgr is x 2024-09-13T18:06:07.183 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T18:06:07.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-09-13T18:06:07.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname $(hostname -s) 2024-09-13T18:06:07.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname $(hostname -s) 2024-09-13T18:06:07.296 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T18:06:07.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:06:07.455 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.4.58+omani008', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 17:57:22.919627', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 13:55:29.568955', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T18:06:07.609 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.100730-reef, sha1 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:06:07.611 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm 2024-09-13T18:06:07.611 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:07.979 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 18:06 /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:07.979 DEBUG:teuthology.orchestra.run.smithi067:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:08.335 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 18:06 /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:08.336 DEBUG:teuthology.orchestra.run.smithi116:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:08.674 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 18:06 /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:08.675 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:08.717 DEBUG:teuthology.orchestra.run.smithi067:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:08.736 DEBUG:teuthology.orchestra.run.smithi116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T18:06:08.771 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 on all hosts... 2024-09-13T18:06:08.771 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T18:06:08.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T18:06:08.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T18:06:10.321 INFO:teuthology.orchestra.run.smithi116.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T18:06:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T18:06:10.792 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T18:06:49.188 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-13T18:06:49.188 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:06:49.189 INFO:teuthology.orchestra.run.smithi067.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T18:06:49.189 INFO:teuthology.orchestra.run.smithi067.stdout: "repo_digests": [ 2024-09-13T18:06:49.189 INFO:teuthology.orchestra.run.smithi067.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T18:06:49.189 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-13T18:06:49.189 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-13T18:06:51.705 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-13T18:06:51.706 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:06:51.706 INFO:teuthology.orchestra.run.smithi116.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T18:06:51.706 INFO:teuthology.orchestra.run.smithi116.stdout: "repo_digests": [ 2024-09-13T18:06:51.706 INFO:teuthology.orchestra.run.smithi116.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T18:06:51.706 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-13T18:06:51.706 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-13T18:06:56.270 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:06:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:06:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T18:06:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-09-13T18:06:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T18:06:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:06:56.270 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:06:56.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-09-13T18:06:56.354 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph 2024-09-13T18:06:56.388 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph 2024-09-13T18:06:56.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-09-13T18:06:56.477 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /etc/ceph 2024-09-13T18:06:56.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /etc/ceph 2024-09-13T18:06:56.535 INFO:tasks.cephadm:Writing seed config... 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T18:06:56.537 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T18:06:56.538 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T18:06:56.539 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-13T18:06:56.540 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-13T18:06:56.541 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:06:56.541 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T18:06:56.576 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d9377e86-71fa-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T18:06:56.577 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T18:06:56.621 DEBUG:teuthology.orchestra.run.smithi007:mgr.x> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.x.service 2024-09-13T18:06:56.665 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T18:06:56.665 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -v bootstrap --fsid d9377e86-71fa-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:06:56.871 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:06:56.871 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', '-v', 'bootstrap', '--fsid', 'd9377e86-71fa-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-09-13T18:06:56.922 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-13T18:06:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T18:06:56.922 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying podman|docker is present... 2024-09-13T18:06:56.967 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-13T18:06:56.967 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying lvm2 is present... 2024-09-13T18:06:56.967 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying time synchronization is in place... 2024-09-13T18:06:56.980 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T18:06:56.980 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T18:06:56.993 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T18:06:56.993 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T18:06:57.006 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-13T18:06:57.020 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-13T18:06:57.021 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-13T18:06:57.021 INFO:teuthology.orchestra.run.smithi007.stdout:Repeating the final host check... 2024-09-13T18:06:57.062 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-13T18:06:57.062 INFO:teuthology.orchestra.run.smithi007.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T18:06:57.062 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl is present 2024-09-13T18:06:57.062 INFO:teuthology.orchestra.run.smithi007.stdout:lvcreate is present 2024-09-13T18:06:57.075 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T18:06:57.075 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T18:06:57.101 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-13T18:06:57.114 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-13T18:06:57.114 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-13T18:06:57.114 INFO:teuthology.orchestra.run.smithi007.stdout:Host looks OK 2024-09-13T18:06:57.114 INFO:teuthology.orchestra.run.smithi007.stdout:Cluster fsid: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:06:57.114 INFO:teuthology.orchestra.run.smithi007.stdout:Acquiring lock 140152357131648 on /run/cephadm/d9377e86-71fa-11ef-bceb-c7b262605968.lock 2024-09-13T18:06:57.115 INFO:teuthology.orchestra.run.smithi007.stdout:Lock 140152357131648 acquired on /run/cephadm/d9377e86-71fa-11ef-bceb-c7b262605968.lock 2024-09-13T18:06:57.115 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 3300 ... 2024-09-13T18:06:57.115 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 6789 ... 2024-09-13T18:06:57.115 INFO:teuthology.orchestra.run.smithi007.stdout:Base mon IP(s) is [172.21.15.7:3300, 172.21.15.7:6789], mon addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-13T18:06:57.122 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.7 metric 100 2024-09-13T18:06:57.122 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 metric 100 2024-09-13T18:06:57.128 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T18:06:57.128 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-13T18:06:57.128 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-13T18:06:57.134 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T18:06:57.134 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T18:06:57.134 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T18:06:57.134 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-13T18:06:57.134 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-13T18:06:57.134 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T18:06:57.135 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-13T18:06:57.135 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-13T18:06:57.135 INFO:teuthology.orchestra.run.smithi007.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T18:06:57.135 INFO:teuthology.orchestra.run.smithi007.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T18:06:57.136 INFO:teuthology.orchestra.run.smithi007.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T18:06:57.647 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 2024-09-13T18:06:57.647 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T18:06:57.647 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T18:06:57.647 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:cdfdf789b01393b98d7733e02a8d993977e2aa05d922747269d27c845cd4920c 2024-09-13T18:06:57.647 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T18:06:57.648 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying config sha256:8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 2024-09-13T18:06:57.648 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T18:06:58.708 INFO:teuthology.orchestra.run.smithi007.stdout:ceph: stdout ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable) 2024-09-13T18:06:58.708 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph version: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable) 2024-09-13T18:06:58.708 INFO:teuthology.orchestra.run.smithi007.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T18:06:59.730 INFO:teuthology.orchestra.run.smithi007.stdout:stat: stdout 167 167 2024-09-13T18:06:59.730 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial keys... 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBEf+Rmdx6VCBAAHu7tftywhCXU41ME86kubw== 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBFf+RmGfl9CxAAULdu2ANvHEJaIhGV2wMj8w== 2024-09-13T18:07:02.846 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBGf+Rm7yy5DhAAkH4R3vBI4ODdSFdNPUu+FA== 2024-09-13T18:07:02.847 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial monmap... 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = pacific 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: set fsid to d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:03.836 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T18:07:03.836 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:07:03.836 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mon... 2024-09-13T18:07:04.878 INFO:teuthology.orchestra.run.smithi007.stdout:create mon.a on 2024-09-13T18:07:05.196 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T18:07:05.416 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T18:07:05.692 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d9377e86-71fa-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d9377e86-71fa-11ef-bceb-c7b262605968.target. 2024-09-13T18:07:05.692 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d9377e86-71fa-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d9377e86-71fa-11ef-bceb-c7b262605968.target. 2024-09-13T18:07:06.052 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a 2024-09-13T18:07:06.052 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T18:07:06.338 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d9377e86-71fa-11ef-bceb-c7b262605968.target.wants/ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d9377e86-71fa-11ef-bceb-c7b262605968@.service. 2024-09-13T18:07:06.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:06 smithi007 podman[30203]: 2024-09-13 18:07:06.903060459 +0000 UTC m=+0.338197777 container start 5a07e5a110e03f125b70c2029feb537a1677c6c970f50564f6ad86e40c16e96d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T18:07:07.033 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:07:07.033 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-13T18:07:07.046 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:07:07.046 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T18:07:07.046 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-13T18:07:07.046 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T18:07:07.047 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon to start... 2024-09-13T18:07:07.047 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon... 2024-09-13T18:07:07.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:06 smithi007 ceph-mon[30222]: mkfs d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:07.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:06 smithi007 ceph-mon[30222]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T18:07:07.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 bash[30203]: 5a07e5a110e03f125b70c2029feb537a1677c6c970f50564f6ad86e40c16e96d 2024-09-13T18:07:07.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 systemd[1]: Started Ceph mon.a for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:07:08.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 ceph-mon[30222]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T18:07:08.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 ceph-mon[30222]: monmap e1: 1 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:07:08.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 ceph-mon[30222]: fsmap 2024-09-13T18:07:08.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 ceph-mon[30222]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T18:07:08.255 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 ceph-mon[30222]: mgrmap e1: no daemons active 2024-09-13T18:07:08.256 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:07 smithi007 ceph-mon[30222]: from='client.? 172.21.15.7:0/2812112048' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T18:07:08.259 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout id: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout services: 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.680364s) 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:08.266 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout data: 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.567+0000 7f39c9400640 1 Processor -- start 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.567+0000 7f39c9400640 1 -- start start 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.567+0000 7f39c9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c407a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.567+0000 7f39c9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c407a870 con 0x7f39c407be40 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.568+0000 7f39c2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c407a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.568+0000 7f39c2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c407a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48322/0 (socket says 172.21.15.7:48322) 2024-09-13T18:07:08.267 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.568+0000 7f39c2800640 1 -- 172.21.15.7:0/163563381 learned_addr learned my addr 172.21.15.7:0/163563381 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.569+0000 7f39c2800640 1 -- 172.21.15.7:0/163563381 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c407a9b0 con 0x7f39c407be40 2024-09-13T18:07:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.571+0000 7f39c2800640 1 --2- 172.21.15.7:0/163563381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c407a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009820 tx=0x7f39b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5c89636111784f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.572+0000 7f39c1e00640 1 -- 172.21.15.7:0/163563381 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39b402ae70 con 0x7f39c407be40 2024-09-13T18:07:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.572+0000 7f39c1e00640 1 -- 172.21.15.7:0/163563381 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4032440 con 0x7f39c407be40 2024-09-13T18:07:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.572+0000 7f39c1e00640 1 -- 172.21.15.7:0/163563381 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39b4032700 con 0x7f39c407be40 2024-09-13T18:07:08.268 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.572+0000 7f39c9400640 1 -- 172.21.15.7:0/163563381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 msgr2=0x7f39c407a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.572+0000 7f39c9400640 1 --2- 172.21.15.7:0/163563381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c407a2a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009820 tx=0x7f39b402a270 comp rx=0 tx=0).stop 2024-09-13T18:07:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.573+0000 7f39c9400640 1 -- 172.21.15.7:0/163563381 shutdown_connections 2024-09-13T18:07:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.573+0000 7f39c9400640 1 --2- 172.21.15.7:0/163563381 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c407a2a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.573+0000 7f39c9400640 1 -- 172.21.15.7:0/163563381 >> 172.21.15.7:0/163563381 conn(0x7f39c4100fa0 msgr2=0x7f39c41033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:08.269 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.573+0000 7f39c9400640 1 -- 172.21.15.7:0/163563381 shutdown_connections 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.573+0000 7f39c9400640 1 -- 172.21.15.7:0/163563381 wait complete. 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.574+0000 7f39c9400640 1 Processor -- start 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.574+0000 7f39c9400640 1 -- start start 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.574+0000 7f39c9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.574+0000 7f39c9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c419b3d0 con 0x7f39c407be40 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.575+0000 7f39c2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.575+0000 7f39c2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c419ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48336/0 (socket says 172.21.15.7:48336) 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.575+0000 7f39c2800640 1 -- 172.21.15.7:0/2812112048 learned_addr learned my addr 172.21.15.7:0/2812112048 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.575+0000 7f39c2800640 1 -- 172.21.15.7:0/2812112048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40094d0 con 0x7f39c407be40 2024-09-13T18:07:08.270 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.575+0000 7f39c2800640 1 --2- 172.21.15.7:0/2812112048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c419ae90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39b40090b0 tx=0x7f39b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.575+0000 7f39bbe00640 1 -- 172.21.15.7:0/2812112048 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39b40308d0 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.576+0000 7f39bbe00640 1 -- 172.21.15.7:0/2812112048 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4030a30 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.576+0000 7f39bbe00640 1 -- 172.21.15.7:0/2812112048 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39b4030cf0 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.576+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c419b5d0 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.576+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c419ba70 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.576+0000 7f39bbe00640 1 -- 172.21.15.7:0/2812112048 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f39b4039040 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.576+0000 7f39bbe00640 1 -- 172.21.15.7:0/2812112048 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f39b40469a0 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.577+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c407a320 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.580+0000 7f39bbe00640 1 -- 172.21.15.7:0/2812112048 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f39b4037070 con 0x7f39c407be40 2024-09-13T18:07:08.271 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.643+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f39c407ae10 con 0x7f39c407be40 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.644+0000 7f39bbe00640 1 -- 172.21.15.7:0/2812112048 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f39b4046b60 con 0x7f39c407be40 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.645+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 msgr2=0x7f39c419ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.645+0000 7f39c9400640 1 --2- 172.21.15.7:0/2812112048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c419ae90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39b40090b0 tx=0x7f39b40046c0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.645+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 shutdown_connections 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.645+0000 7f39c9400640 1 --2- 172.21.15.7:0/2812112048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39c407be40 0x7f39c419ae90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.645+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 >> 172.21.15.7:0/2812112048 conn(0x7f39c4100fa0 msgr2=0x7f39c4102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.645+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 shutdown_connections 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:07.645+0000 7f39c9400640 1 -- 172.21.15.7:0/2812112048 wait complete. 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:mon is available 2024-09-13T18:07:08.272 INFO:teuthology.orchestra.run.smithi007.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T18:07:09.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:08 smithi007 ceph-mon[30222]: from='client.? 172.21.15.7:0/2325817615' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T18:07:09.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:08 smithi007 ceph-mon[30222]: from='client.? 172.21.15.7:0/2325817615' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T18:07:09.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:09.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T18:07:09.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:09.426 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-13T18:07:09.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T18:07:09.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T18:07:09.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T18:07:09.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T18:07:09.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:09.427 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T18:07:09.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T18:07:09.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:09.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T18:07:09.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T18:07:09.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T18:07:09.428 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T18:07:09.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T18:07:09.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T18:07:09.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.754+0000 7f0054400640 1 Processor -- start 2024-09-13T18:07:09.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.754+0000 7f0054400640 1 -- start start 2024-09-13T18:07:09.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.754+0000 7f0054400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:09.429 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.754+0000 7f0054400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c108320 con 0x7f004c107950 2024-09-13T18:07:09.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.755+0000 7f0051a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:09.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.755+0000 7f0051a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48346/0 (socket says 172.21.15.7:48346) 2024-09-13T18:07:09.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.755+0000 7f0051a00640 1 -- 172.21.15.7:0/1615097285 learned_addr learned my addr 172.21.15.7:0/1615097285 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:09.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.755+0000 7f0051a00640 1 -- 172.21.15.7:0/1615097285 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c108b50 con 0x7f004c107950 2024-09-13T18:07:09.430 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.756+0000 7f0051a00640 1 --2- 172.21.15.7:0/1615097285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c107d50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0040009e80 tx=0x7f004002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec26418bd6acff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:09.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.756+0000 7f004be00640 1 -- 172.21.15.7:0/1615097285 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0040031400 con 0x7f004c107950 2024-09-13T18:07:09.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.756+0000 7f004be00640 1 -- 172.21.15.7:0/1615097285 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004002d050 con 0x7f004c107950 2024-09-13T18:07:09.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.756+0000 7f004be00640 1 -- 172.21.15.7:0/1615097285 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00400316b0 con 0x7f004c107950 2024-09-13T18:07:09.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.757+0000 7f0054400640 1 -- 172.21.15.7:0/1615097285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 msgr2=0x7f004c107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:09.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.757+0000 7f0054400640 1 --2- 172.21.15.7:0/1615097285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c107d50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0040009e80 tx=0x7f004002a7a0 comp rx=0 tx=0).stop 2024-09-13T18:07:09.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.757+0000 7f0054400640 1 -- 172.21.15.7:0/1615097285 shutdown_connections 2024-09-13T18:07:09.431 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.757+0000 7f0054400640 1 --2- 172.21.15.7:0/1615097285 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c107d50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.757+0000 7f0054400640 1 -- 172.21.15.7:0/1615097285 >> 172.21.15.7:0/1615097285 conn(0x7f004c07af30 msgr2=0x7f004c07b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.757+0000 7f0054400640 1 -- 172.21.15.7:0/1615097285 shutdown_connections 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.757+0000 7f0054400640 1 -- 172.21.15.7:0/1615097285 wait complete. 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.758+0000 7f0054400640 1 Processor -- start 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.758+0000 7f0054400640 1 -- start start 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.758+0000 7f0054400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.758+0000 7f0054400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c19b3d0 con 0x7f004c107950 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.759+0000 7f0051a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.759+0000 7f0051a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c19ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48360/0 (socket says 172.21.15.7:48360) 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.759+0000 7f0051a00640 1 -- 172.21.15.7:0/2325817615 learned_addr learned my addr 172.21.15.7:0/2325817615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.759+0000 7f0051a00640 1 -- 172.21.15.7:0/2325817615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040009b30 con 0x7f004c107950 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.759+0000 7f0051a00640 1 --2- 172.21.15.7:0/2325817615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c19ae90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0040034040 tx=0x7f0040004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.760+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004003c690 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.760+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004003c7f0 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.760+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f004003cab0 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.760+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c19b5d0 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.760+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c19ba70 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.760+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0040038040 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.760+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f004003b720 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.761+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c108f30 con 0x7f004c107950 2024-09-13T18:07:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.763+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f004004c060 con 0x7f004c107950 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.824+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f004c1090c0 con 0x7f004c107950 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.829+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f004003be20 con 0x7f004c107950 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.829+0000 7f004a000640 1 -- 172.21.15.7:0/2325817615 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f0040042070 con 0x7f004c107950 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.830+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 msgr2=0x7f004c19ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.830+0000 7f0054400640 1 --2- 172.21.15.7:0/2325817615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c19ae90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0040034040 tx=0x7f0040004a40 comp rx=0 tx=0).stop 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.830+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 shutdown_connections 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.830+0000 7f0054400640 1 --2- 172.21.15.7:0/2325817615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f004c107950 0x7f004c19ae90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.830+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 >> 172.21.15.7:0/2325817615 conn(0x7f004c07af30 msgr2=0x7f004c18f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.830+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 shutdown_connections 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:08.830+0000 7f0054400640 1 -- 172.21.15.7:0/2325817615 wait complete. 2024-09-13T18:07:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:Generating new minimal ceph.conf... 2024-09-13T18:07:10.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:09 smithi007 ceph-mon[30222]: from='client.? 172.21.15.7:0/3206867077' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:07:10.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.893+0000 7f451ce00640 1 Processor -- start 2024-09-13T18:07:10.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.894+0000 7f451ce00640 1 -- start start 2024-09-13T18:07:10.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.894+0000 7f451ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451807fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:10.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.894+0000 7f451ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180801e0 con 0x7f451807f810 2024-09-13T18:07:10.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.894+0000 7f4515e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451807fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:10.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.894+0000 7f4515e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451807fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48364/0 (socket says 172.21.15.7:48364) 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.894+0000 7f4515e00640 1 -- 172.21.15.7:0/3380692996 learned_addr learned my addr 172.21.15.7:0/3380692996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.895+0000 7f4515e00640 1 -- 172.21.15.7:0/3380692996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451810cf20 con 0x7f451807f810 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.896+0000 7f4515e00640 1 --2- 172.21.15.7:0/3380692996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451807fc10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4508009820 tx=0x7f450802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d83b9c4302402b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.896+0000 7f4515400640 1 -- 172.21.15.7:0/3380692996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f450802ae70 con 0x7f451807f810 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.896+0000 7f4515400640 1 -- 172.21.15.7:0/3380692996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45080328e0 con 0x7f451807f810 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.896+0000 7f4515400640 1 -- 172.21.15.7:0/3380692996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45080308c0 con 0x7f451807f810 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.897+0000 7f451ce00640 1 -- 172.21.15.7:0/3380692996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 msgr2=0x7f451807fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.897+0000 7f451ce00640 1 --2- 172.21.15.7:0/3380692996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451807fc10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4508009820 tx=0x7f450802a270 comp rx=0 tx=0).stop 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.897+0000 7f451ce00640 1 -- 172.21.15.7:0/3380692996 shutdown_connections 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.897+0000 7f451ce00640 1 --2- 172.21.15.7:0/3380692996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451807fc10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.897+0000 7f451ce00640 1 -- 172.21.15.7:0/3380692996 >> 172.21.15.7:0/3380692996 conn(0x7f451807af70 msgr2=0x7f451807d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.897+0000 7f451ce00640 1 -- 172.21.15.7:0/3380692996 shutdown_connections 2024-09-13T18:07:10.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.897+0000 7f451ce00640 1 -- 172.21.15.7:0/3380692996 wait complete. 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.898+0000 7f451ce00640 1 Processor -- start 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.898+0000 7f451ce00640 1 -- start start 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.898+0000 7f451ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.898+0000 7f451ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451819ffb0 con 0x7f451807f810 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.898+0000 7f4515e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.898+0000 7f4515e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48366/0 (socket says 172.21.15.7:48366) 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.898+0000 7f4515e00640 1 -- 172.21.15.7:0/3206867077 learned_addr learned my addr 172.21.15.7:0/3206867077 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.899+0000 7f4515e00640 1 -- 172.21.15.7:0/3206867077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080094d0 con 0x7f451807f810 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.899+0000 7f4515e00640 1 --2- 172.21.15.7:0/3206867077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451819fa70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45080305d0 tx=0x7f4508032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.899+0000 7f450ea00640 1 -- 172.21.15.7:0/3206867077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4508032c60 con 0x7f451807f810 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.899+0000 7f450ea00640 1 -- 172.21.15.7:0/3206867077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4508032dc0 con 0x7f451807f810 2024-09-13T18:07:10.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.899+0000 7f450ea00640 1 -- 172.21.15.7:0/3206867077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f450803a770 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.899+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45181a01b0 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.899+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45181a0650 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.900+0000 7f450ea00640 1 -- 172.21.15.7:0/3206867077 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4508039040 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.900+0000 7f450ea00640 1 -- 172.21.15.7:0/3206867077 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f45080426a0 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.901+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4518110150 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.903+0000 7f450ea00640 1 -- 172.21.15.7:0/3206867077 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4508049060 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.965+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4518110310 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.965+0000 7f450ea00640 1 -- 172.21.15.7:0/3206867077 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f450803f070 con 0x7f451807f810 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.966+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 msgr2=0x7f451819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.966+0000 7f451ce00640 1 --2- 172.21.15.7:0/3206867077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451819fa70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45080305d0 tx=0x7f4508032670 comp rx=0 tx=0).stop 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.966+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 shutdown_connections 2024-09-13T18:07:10.564 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.966+0000 7f451ce00640 1 --2- 172.21.15.7:0/3206867077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f451807f810 0x7f451819fa70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:10.565 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.966+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 >> 172.21.15.7:0/3206867077 conn(0x7f451807af70 msgr2=0x7f451807bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:10.565 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.966+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 shutdown_connections 2024-09-13T18:07:10.565 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:09.966+0000 7f451ce00640 1 -- 172.21.15.7:0/3206867077 wait complete. 2024-09-13T18:07:10.565 INFO:teuthology.orchestra.run.smithi007.stdout:Restarting the monitor... 2024-09-13T18:07:10.957 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:10 smithi007 systemd[1]: Stopping Ceph mon.a for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:07:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a[30218]: 2024-09-13T18:07:10.954+0000 7fb76f600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a[30218]: 2024-09-13T18:07:10.954+0000 7fb76f600640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T18:07:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:11 smithi007 podman[30464]: 2024-09-13 18:07:11.180392507 +0000 UTC m=+0.391511674 container died 5a07e5a110e03f125b70c2029feb537a1677c6c970f50564f6ad86e40c16e96d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T18:07:11.746 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:11 smithi007 podman[30464]: 2024-09-13 18:07:11.568406159 +0000 UTC m=+0.779525324 container cleanup 5a07e5a110e03f125b70c2029feb537a1677c6c970f50564f6ad86e40c16e96d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:07:11.746 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:11 smithi007 bash[30464]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a 2024-09-13T18:07:11.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:11 smithi007 podman[30477]: 2024-09-13 18:07:11.744193636 +0000 UTC m=+0.552174038 container remove 5a07e5a110e03f125b70c2029feb537a1677c6c970f50564f6ad86e40c16e96d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T18:07:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 systemd[1]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T18:07:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 systemd[1]: Stopped Ceph mon.a for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:07:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 systemd[1]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.245s CPU time. 2024-09-13T18:07:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 systemd[1]: Starting Ceph mon.a for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:07:12.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 podman[30569]: 2024-09-13 18:07:12.21861836 +0000 UTC m=+0.027215197 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:07:12.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 podman[30569]: 2024-09-13 18:07:12.357686938 +0000 UTC m=+0.166283765 container create 268cd935a6fd2889d5a3f2a34133aaf6ab3b40c97129c820b5cea5248c39a252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T18:07:12.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 podman[30569]: 2024-09-13 18:07:12.555745038 +0000 UTC m=+0.364341875 container init 268cd935a6fd2889d5a3f2a34133aaf6ab3b40c97129c820b5cea5248c39a252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-13T18:07:12.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 podman[30569]: 2024-09-13 18:07:12.562948138 +0000 UTC m=+0.371544965 container start 268cd935a6fd2889d5a3f2a34133aaf6ab3b40c97129c820b5cea5248c39a252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T18:07:12.641 INFO:teuthology.orchestra.run.smithi007.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T18:07:12.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T18:07:12.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T18:07:12.896 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: pidfile_write: ignore empty --pid-file 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: load: jerasure load: lrc 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: RocksDB version: 7.9.2 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Git sha 0 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: DB SUMMARY 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: DB Session ID: PM7GLUNTXEGHY8ZR2Z2E 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: CURRENT file: CURRENT 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100693 ; 2024-09-13T18:07:12.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.error_if_exists: 0 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.create_if_missing: 0 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.paranoid_checks: 1 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.env: 0x556f198b5bc0 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.info_log: 0x556f28a60b40 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.statistics: (nil) 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.use_fsync: 0 2024-09-13T18:07:12.898 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_log_file_size: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.allow_fallocate: 1 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.use_direct_reads: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.db_log_dir: 2024-09-13T18:07:12.899 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.wal_dir: 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.write_buffer_manager: 0x556f28a6e320 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T18:07:12.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.unordered_write: 0 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.row_cache: None 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.wal_filter: None 2024-09-13T18:07:12.901 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.two_write_queues: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.wal_compression: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.atomic_flush: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.log_readahead_size: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T18:07:12.902 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T18:07:12.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T18:07:12.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T18:07:12.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_background_jobs: 2 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_background_compactions: -1 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_subcompactions: 1 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_open_files: -1 2024-09-13T18:07:12.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_background_flushes: -1 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Compression algorithms supported: 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kZSTD supported: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kXpressCompression supported: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kBZip2Compression supported: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kLZ4Compression supported: 1 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kZlibCompression supported: 1 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T18:07:12.906 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: kSnappyCompression supported: 1 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.merge_operator: 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_filter: None 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556f28a60760) 2024-09-13T18:07:12.907 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x556f28a55350 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-09-13T18:07:12.908 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-09-13T18:07:12.909 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T18:07:12.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression: NoCompression 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.num_levels: 7 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T18:07:12.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T18:07:12.912 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T18:07:12.913 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T18:07:12.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T18:07:12.915 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.inplace_update_support: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.bloom_locality: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.max_successive_merges: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.ttl: 2592000 2024-09-13T18:07:12.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.enable_blob_files: false 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.min_blob_size: 0 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T18:07:12.917 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2d74d115-a5cb-45d2-b200-6709f66e3b31 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250832606103, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250832607994, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95749, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 93721, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 14116, "raw_average_key_size": 50, "raw_value_size": 86068, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726250832, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2d74d115-a5cb-45d2-b200-6709f66e3b31", "db_session_id": "PM7GLUNTXEGHY8ZR2Z2E", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250832608170, "job": 1, "event": "recovery_finished"} 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556f28a82e00 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: DB pointer 0x556f28b76000 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T18:07:12.918 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 95.37 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:07:12.919 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 95.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 72.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T18:07:12.920 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 15.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 15.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x556f28a55350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???) e1 preinit fsid d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???).mds e1 new map 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???).mds e1 print_map 2024-09-13T18:07:12.921 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 bash[30569]: 268cd935a6fd2889d5a3f2a34133aaf6ab3b40c97129c820b5cea5248c39a252 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 systemd[1]: Started Ceph mon.a for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:07:12.922 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T18:07:12.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: monmap e1: 1 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:07:12.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: fsmap 2024-09-13T18:07:12.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T18:07:12.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:12 smithi007 ceph-mon[30588]: mgrmap e1: no daemons active 2024-09-13T18:07:13.802 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.152+0000 7fb16cc00640 1 Processor -- start 2024-09-13T18:07:13.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.152+0000 7fb16cc00640 1 -- start start 2024-09-13T18:07:13.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.152+0000 7fb16cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb168105b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:13.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.152+0000 7fb16cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168106110 con 0x7fb168105740 2024-09-13T18:07:13.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.153+0000 7fb165e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb168105b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:13.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.153+0000 7fb165e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb168105b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48380/0 (socket says 172.21.15.7:48380) 2024-09-13T18:07:13.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.153+0000 7fb165e00640 1 -- 172.21.15.7:0/217545833 learned_addr learned my addr 172.21.15.7:0/217545833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:13.808 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.153+0000 7fb165e00640 1 -- 172.21.15.7:0/217545833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168106940 con 0x7fb168105740 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.156+0000 7fb165e00640 1 --2- 172.21.15.7:0/217545833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb168105b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb158009820 tx=0x7fb15802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fada38172dcc10be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.156+0000 7fb164a00640 1 -- 172.21.15.7:0/217545833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb15802ae70 con 0x7fb168105740 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.156+0000 7fb164a00640 1 -- 172.21.15.7:0/217545833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1580328e0 con 0x7fb168105740 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.156+0000 7fb164a00640 1 -- 172.21.15.7:0/217545833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1580308c0 con 0x7fb168105740 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.157+0000 7fb16cc00640 1 -- 172.21.15.7:0/217545833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 msgr2=0x7fb168105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.157+0000 7fb16cc00640 1 --2- 172.21.15.7:0/217545833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb168105b40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb158009820 tx=0x7fb15802a270 comp rx=0 tx=0).stop 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.157+0000 7fb16cc00640 1 -- 172.21.15.7:0/217545833 shutdown_connections 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.157+0000 7fb16cc00640 1 --2- 172.21.15.7:0/217545833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb168105b40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.157+0000 7fb16cc00640 1 -- 172.21.15.7:0/217545833 >> 172.21.15.7:0/217545833 conn(0x7fb168100f30 msgr2=0x7fb168103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.157+0000 7fb16cc00640 1 -- 172.21.15.7:0/217545833 shutdown_connections 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.157+0000 7fb16cc00640 1 -- 172.21.15.7:0/217545833 wait complete. 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.158+0000 7fb16cc00640 1 Processor -- start 2024-09-13T18:07:13.809 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.158+0000 7fb16cc00640 1 -- start start 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.158+0000 7fb16cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb16819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.158+0000 7fb16cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16819bba0 con 0x7fb168105740 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.159+0000 7fb165e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb16819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.159+0000 7fb165e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb16819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48392/0 (socket says 172.21.15.7:48392) 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.159+0000 7fb165e00640 1 -- 172.21.15.7:0/279745706 learned_addr learned my addr 172.21.15.7:0/279745706 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.159+0000 7fb165e00640 1 -- 172.21.15.7:0/279745706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580094d0 con 0x7fb168105740 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.159+0000 7fb165e00640 1 --2- 172.21.15.7:0/279745706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb16819b660 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb1580305d0 tx=0x7fb158032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.160+0000 7fb15ea00640 1 -- 172.21.15.7:0/279745706 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb158032c60 con 0x7fb168105740 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.160+0000 7fb15ea00640 1 -- 172.21.15.7:0/279745706 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb158032dc0 con 0x7fb168105740 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.160+0000 7fb15ea00640 1 -- 172.21.15.7:0/279745706 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb15803a770 con 0x7fb168105740 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.160+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16819bda0 con 0x7fb168105740 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.160+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16819c240 con 0x7fb168105740 2024-09-13T18:07:13.810 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.160+0000 7fb15ea00640 1 -- 172.21.15.7:0/279745706 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb158039040 con 0x7fb168105740 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.160+0000 7fb15ea00640 1 -- 172.21.15.7:0/279745706 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb158042360 con 0x7fb168105740 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.161+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb168109b70 con 0x7fb168105740 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.164+0000 7fb15ea00640 1 -- 172.21.15.7:0/279745706 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb158049060 con 0x7fb168105740 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.225+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fb168109d30 con 0x7fb168105740 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.227+0000 7fb15ea00640 1 -- 172.21.15.7:0/279745706 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb15803f070 con 0x7fb168105740 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.228+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 msgr2=0x7fb16819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.228+0000 7fb16cc00640 1 --2- 172.21.15.7:0/279745706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb16819b660 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb1580305d0 tx=0x7fb158032670 comp rx=0 tx=0).stop 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.228+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 shutdown_connections 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.228+0000 7fb16cc00640 1 --2- 172.21.15.7:0/279745706 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb168105740 0x7fb16819b660 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.228+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 >> 172.21.15.7:0/279745706 conn(0x7fb168100f30 msgr2=0x7fb1681019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.228+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 shutdown_connections 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:13.228+0000 7fb16cc00640 1 -- 172.21.15.7:0/279745706 wait complete. 2024-09-13T18:07:13.811 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T18:07:13.829 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:07:13.829 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mgr... 2024-09-13T18:07:13.829 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T18:07:13.830 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T18:07:14.172 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.x 2024-09-13T18:07:14.172 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-13T18:07:14.414 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d9377e86-71fa-11ef-bceb-c7b262605968.target.wants/ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d9377e86-71fa-11ef-bceb-c7b262605968@.service. 2024-09-13T18:07:14.446 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:14 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/279745706' entity='client.admin' 2024-09-13T18:07:14.761 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:14 smithi007 systemd[1]: Starting Ceph mgr.x for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:07:15.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:14 smithi007 podman[30795]: 2024-09-13 18:07:14.663472121 +0000 UTC m=+0.027222083 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:07:19.790 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:19 smithi007 podman[30795]: 2024-09-13 18:07:19.385359894 +0000 UTC m=+4.749109833 container create 09f2ff7bc14d4b592524bd74c6f3278b8a408fc3dcc14d9cf0eb642647ebcb4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T18:07:24.138 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:07:24.138 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-13T18:07:24.154 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:07:24.154 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T18:07:24.154 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-13T18:07:24.154 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T18:07:24.175 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:07:24.175 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-13T18:07:24.191 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:07:24.191 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T18:07:24.191 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-13T18:07:24.191 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T18:07:24.191 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr to start... 2024-09-13T18:07:24.191 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr... 2024-09-13T18:07:24.278 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 podman[30795]: 2024-09-13 18:07:24.003845947 +0000 UTC m=+9.367595908 container init 09f2ff7bc14d4b592524bd74c6f3278b8a408fc3dcc14d9cf0eb642647ebcb4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T18:07:24.278 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 podman[30795]: 2024-09-13 18:07:24.010650106 +0000 UTC m=+9.374400045 container start 09f2ff7bc14d4b592524bd74c6f3278b8a408fc3dcc14d9cf0eb642647ebcb4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T18:07:24.279 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 bash[30795]: 09f2ff7bc14d4b592524bd74c6f3278b8a408fc3dcc14d9cf0eb642647ebcb4a 2024-09-13T18:07:24.279 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 systemd[1]: Started Ceph mgr.x for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:07:24.279 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:24.201+0000 7efc91834040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:07:24.279 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:24.275+0000 7efc91834040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:07:24.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:24.482+0000 7efc91834040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:07:24.846 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:24.571+0000 7efc91834040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:07:24.846 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:24.754+0000 7efc91834040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:07:25.171 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:24.935+0000 7efc91834040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:07:25.172 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:24 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2461669827' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T18:07:25.454 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:25 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:25.325+0000 7efc91834040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:07:25.454 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:25 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:25.401+0000 7efc91834040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T18:07:25.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:25.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T18:07:25.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T18:07:25.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T18:07:25.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T18:07:25.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T18:07:25.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T18:07:25.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:25.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T18:07:25.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T18:07:06.966451+0000", 2024-09-13T18:07:25.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.716+0000 7fdd67800640 1 Processor -- start 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.716+0000 7fdd67800640 1 -- start start 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.716+0000 7fdd67800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd60107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.716+0000 7fdd67800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60108320 con 0x7fdd60107950 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.717+0000 7fdd64e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd60107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.717+0000 7fdd64e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd60107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40430/0 (socket says 172.21.15.7:40430) 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.717+0000 7fdd64e00640 1 -- 172.21.15.7:0/2116296579 learned_addr learned my addr 172.21.15.7:0/2116296579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.717+0000 7fdd64e00640 1 -- 172.21.15.7:0/2116296579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60108b20 con 0x7fdd60107950 2024-09-13T18:07:25.476 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.718+0000 7fdd64e00640 1 --2- 172.21.15.7:0/2116296579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd60107d50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009820 tx=0x7fdd5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2c57afffb2c53a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.718+0000 7fdd5f400640 1 -- 172.21.15.7:0/2116296579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd5402ae70 con 0x7fdd60107950 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd5f400640 1 -- 172.21.15.7:0/2116296579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd540328e0 con 0x7fdd60107950 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd5f400640 1 -- 172.21.15.7:0/2116296579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd540308c0 con 0x7fdd60107950 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd67800640 1 -- 172.21.15.7:0/2116296579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 msgr2=0x7fdd60107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd67800640 1 --2- 172.21.15.7:0/2116296579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd60107d50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009820 tx=0x7fdd5402a270 comp rx=0 tx=0).stop 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd67800640 1 -- 172.21.15.7:0/2116296579 shutdown_connections 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd67800640 1 --2- 172.21.15.7:0/2116296579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd60107d50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd67800640 1 -- 172.21.15.7:0/2116296579 >> 172.21.15.7:0/2116296579 conn(0x7fdd6007af00 msgr2=0x7fdd6007b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd67800640 1 -- 172.21.15.7:0/2116296579 shutdown_connections 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.719+0000 7fdd67800640 1 -- 172.21.15.7:0/2116296579 wait complete. 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.720+0000 7fdd67800640 1 Processor -- start 2024-09-13T18:07:25.477 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.721+0000 7fdd67800640 1 -- start start 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.721+0000 7fdd67800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd6019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.721+0000 7fdd67800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6019bba0 con 0x7fdd60107950 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.721+0000 7fdd64e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd6019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.721+0000 7fdd64e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd6019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40436/0 (socket says 172.21.15.7:40436) 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.721+0000 7fdd64e00640 1 -- 172.21.15.7:0/2461669827 learned_addr learned my addr 172.21.15.7:0/2461669827 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.722+0000 7fdd64e00640 1 -- 172.21.15.7:0/2461669827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540094d0 con 0x7fdd60107950 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.722+0000 7fdd64e00640 1 --2- 172.21.15.7:0/2461669827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd6019b660 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdd540097f0 tx=0x7fdd54030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.722+0000 7fdd5d600640 1 -- 172.21.15.7:0/2461669827 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd54032d90 con 0x7fdd60107950 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.722+0000 7fdd5d600640 1 -- 172.21.15.7:0/2461669827 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd5403b8d0 con 0x7fdd60107950 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.722+0000 7fdd5d600640 1 -- 172.21.15.7:0/2461669827 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd5403a780 con 0x7fdd60107950 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.723+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6019bda0 con 0x7fdd60107950 2024-09-13T18:07:25.478 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.723+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6019c240 con 0x7fdd60107950 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.723+0000 7fdd5d600640 1 -- 172.21.15.7:0/2461669827 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdd54039040 con 0x7fdd60107950 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.723+0000 7fdd5d600640 1 -- 172.21.15.7:0/2461669827 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdd5404c350 con 0x7fdd60107950 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.724+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6010bd50 con 0x7fdd60107950 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.726+0000 7fdd5d600640 1 -- 172.21.15.7:0/2461669827 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fdd54049060 con 0x7fdd60107950 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.791+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdd6010bf10 con 0x7fdd60107950 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.791+0000 7fdd5d600640 1 -- 172.21.15.7:0/2461669827 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7fdd5403f070 con 0x7fdd60107950 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.792+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 msgr2=0x7fdd6019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.792+0000 7fdd67800640 1 --2- 172.21.15.7:0/2461669827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd6019b660 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdd540097f0 tx=0x7fdd54030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.792+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 shutdown_connections 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.792+0000 7fdd67800640 1 --2- 172.21.15.7:0/2461669827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd60107950 0x7fdd6019b660 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.792+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 >> 172.21.15.7:0/2461669827 conn(0x7fdd6007af00 msgr2=0x7fdd60105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:25.479 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.793+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 shutdown_connections 2024-09-13T18:07:25.480 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:24.793+0000 7fdd67800640 1 -- 172.21.15.7:0/2461669827 wait complete. 2024-09-13T18:07:25.480 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (1/15)... 2024-09-13T18:07:25.790 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:25 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:25.620+0000 7efc91834040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:07:27.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:26.769+0000 7efc91834040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:07:27.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:26.853+0000 7efc91834040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:07:28.209 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1930380731' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T18:07:28.209 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:27.880+0000 7efc91834040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:07:28.209 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.028+0000 7efc91834040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:07:28.210 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.205+0000 7efc91834040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:07:28.463 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.282+0000 7efc91834040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:07:28.743 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.463+0000 7efc91834040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:07:28.743 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.549+0000 7efc91834040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:07:28.743 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.623+0000 7efc91834040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:07:28.751 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:28.751 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T18:07:28.752 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T18:07:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T18:07:28.761 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T18:07:28.762 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T18:07:06.966451+0000", 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:07:28.763 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.964+0000 7f2f7f800640 1 Processor -- start 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.964+0000 7f2f7f800640 1 -- start start 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.964+0000 7f2f7f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f78105b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.964+0000 7f2f7f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78106110 con 0x7f2f78105740 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.965+0000 7f2f7ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f78105b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.965+0000 7f2f7ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f78105b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40448/0 (socket says 172.21.15.7:40448) 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.965+0000 7f2f7ce00640 1 -- 172.21.15.7:0/3242937646 learned_addr learned my addr 172.21.15.7:0/3242937646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.965+0000 7f2f7ce00640 1 -- 172.21.15.7:0/3242937646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78106940 con 0x7f2f78105740 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.966+0000 7f2f7ce00640 1 --2- 172.21.15.7:0/3242937646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f78105b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009820 tx=0x7f2f6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ae573667066f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.967+0000 7f2f77400640 1 -- 172.21.15.7:0/3242937646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c02ae70 con 0x7f2f78105740 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.967+0000 7f2f77400640 1 -- 172.21.15.7:0/3242937646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f6c0328e0 con 0x7f2f78105740 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.967+0000 7f2f77400640 1 -- 172.21.15.7:0/3242937646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c0308c0 con 0x7f2f78105740 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.968+0000 7f2f7f800640 1 -- 172.21.15.7:0/3242937646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 msgr2=0x7f2f78105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:28.764 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.968+0000 7f2f7f800640 1 --2- 172.21.15.7:0/3242937646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f78105b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009820 tx=0x7f2f6c02a270 comp rx=0 tx=0).stop 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.968+0000 7f2f7f800640 1 -- 172.21.15.7:0/3242937646 shutdown_connections 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.968+0000 7f2f7f800640 1 --2- 172.21.15.7:0/3242937646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f78105b40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.968+0000 7f2f7f800640 1 -- 172.21.15.7:0/3242937646 >> 172.21.15.7:0/3242937646 conn(0x7f2f78100f30 msgr2=0x7f2f78103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.968+0000 7f2f7f800640 1 -- 172.21.15.7:0/3242937646 shutdown_connections 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.968+0000 7f2f7f800640 1 -- 172.21.15.7:0/3242937646 wait complete. 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.969+0000 7f2f7f800640 1 Processor -- start 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.969+0000 7f2f7f800640 1 -- start start 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.970+0000 7f2f7f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f7819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:28.765 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.970+0000 7f2f7f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7819bc00 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.970+0000 7f2f7ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f7819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.970+0000 7f2f7ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f7819b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40452/0 (socket says 172.21.15.7:40452) 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.970+0000 7f2f7ce00640 1 -- 172.21.15.7:0/1930380731 learned_addr learned my addr 172.21.15.7:0/1930380731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.970+0000 7f2f7ce00640 1 -- 172.21.15.7:0/1930380731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0094d0 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.971+0000 7f2f7ce00640 1 --2- 172.21.15.7:0/1930380731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f7819b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097f0 tx=0x7f2f6c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.971+0000 7f2f75600640 1 -- 172.21.15.7:0/1930380731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c032d90 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.971+0000 7f2f75600640 1 -- 172.21.15.7:0/1930380731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f6c03b8d0 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.971+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7819be00 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.971+0000 7f2f75600640 1 -- 172.21.15.7:0/1930380731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c03a780 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.971+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7819c2a0 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.972+0000 7f2f75600640 1 -- 172.21.15.7:0/1930380731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2f6c039040 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.972+0000 7f2f75600640 1 -- 172.21.15.7:0/1930380731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f6c044b80 con 0x7f2f78105740 2024-09-13T18:07:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.972+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f78109b70 con 0x7f2f78105740 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:27.975+0000 7f2f75600640 1 -- 172.21.15.7:0/1930380731 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f2f6c049060 con 0x7f2f78105740 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.041+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2f7819ebe0 con 0x7f2f78105740 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.041+0000 7f2f75600640 1 -- 172.21.15.7:0/1930380731 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f2f6c03f070 con 0x7f2f78105740 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.042+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 msgr2=0x7f2f7819b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.042+0000 7f2f7f800640 1 --2- 172.21.15.7:0/1930380731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f7819b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097f0 tx=0x7f2f6c030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.042+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 shutdown_connections 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.042+0000 7f2f7f800640 1 --2- 172.21.15.7:0/1930380731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f78105740 0x7f2f7819b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.042+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 >> 172.21.15.7:0/1930380731 conn(0x7f2f78100f30 msgr2=0x7f2f78101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.042+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 shutdown_connections 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:28.042+0000 7f2f7f800640 1 -- 172.21.15.7:0/1930380731 wait complete. 2024-09-13T18:07:28.767 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (2/15)... 2024-09-13T18:07:29.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.816+0000 7efc91834040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:07:29.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.895+0000 7efc91834040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:07:29.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:28.977+0000 7efc91834040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:07:29.540 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:29 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:29.078+0000 7efc91834040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:07:29.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:29 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:29.151+0000 7efc91834040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:07:29.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:29 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:29.224+0000 7efc91834040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:07:30.540 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:30.167+0000 7efc91834040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: Activating manager daemon x 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: mgrmap e2: x(active, starting, since 0.00382905s) 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: Manager daemon x is now available 2024-09-13T18:07:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:07:30.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T18:07:30.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' 2024-09-13T18:07:30.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' 2024-09-13T18:07:30.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:30 smithi007 ceph-mon[30588]: from='mgr.14100 172.21.15.7:0/3464293512' entity='mgr.x' 2024-09-13T18:07:32.079 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:32.079 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:07:32.079 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:07:32.079 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T18:07:32.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T18:07:32.083 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T18:07:32.091 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T18:07:32.091 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T18:07:32.091 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T18:07:32.093 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T18:07:06.966451+0000", 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.222+0000 7f8ae7e00640 1 Processor -- start 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.222+0000 7f8ae7e00640 1 -- start start 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.222+0000 7f8ae7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae0107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.222+0000 7f8ae7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0108320 con 0x7f8ae0107950 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.222+0000 7f8ae5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae0107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.222+0000 7f8ae5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae0107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40532/0 (socket says 172.21.15.7:40532) 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.222+0000 7f8ae5400640 1 -- 172.21.15.7:0/123825262 learned_addr learned my addr 172.21.15.7:0/123825262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.223+0000 7f8ae5400640 1 -- 172.21.15.7:0/123825262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0108b20 con 0x7f8ae0107950 2024-09-13T18:07:32.094 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.224+0000 7f8ae5400640 1 --2- 172.21.15.7:0/123825262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae0107d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009820 tx=0x7f8ad402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f66a7027b57f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.224+0000 7f8adfe00640 1 -- 172.21.15.7:0/123825262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad402ae70 con 0x7f8ae0107950 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.224+0000 7f8adfe00640 1 -- 172.21.15.7:0/123825262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ad40328e0 con 0x7f8ae0107950 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.224+0000 7f8adfe00640 1 -- 172.21.15.7:0/123825262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad40308c0 con 0x7f8ae0107950 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.224+0000 7f8ae7e00640 1 -- 172.21.15.7:0/123825262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 msgr2=0x7f8ae0107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.224+0000 7f8ae7e00640 1 --2- 172.21.15.7:0/123825262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae0107d50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009820 tx=0x7f8ad402a270 comp rx=0 tx=0).stop 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.225+0000 7f8ae7e00640 1 -- 172.21.15.7:0/123825262 shutdown_connections 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.225+0000 7f8ae7e00640 1 --2- 172.21.15.7:0/123825262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae0107d50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.225+0000 7f8ae7e00640 1 -- 172.21.15.7:0/123825262 >> 172.21.15.7:0/123825262 conn(0x7f8ae007af00 msgr2=0x7f8ae007b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.225+0000 7f8ae7e00640 1 -- 172.21.15.7:0/123825262 shutdown_connections 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.225+0000 7f8ae7e00640 1 -- 172.21.15.7:0/123825262 wait complete. 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.226+0000 7f8ae7e00640 1 Processor -- start 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.226+0000 7f8ae7e00640 1 -- start start 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.226+0000 7f8ae7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.095 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.226+0000 7f8ae7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae019bba0 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.226+0000 7f8ae5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.226+0000 7f8ae5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40544/0 (socket says 172.21.15.7:40544) 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.226+0000 7f8ae5400640 1 -- 172.21.15.7:0/405759540 learned_addr learned my addr 172.21.15.7:0/405759540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.227+0000 7f8ae5400640 1 -- 172.21.15.7:0/405759540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad40094d0 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.227+0000 7f8ae5400640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae019b660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40097f0 tx=0x7f8ad4030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.227+0000 7f8ade000640 1 -- 172.21.15.7:0/405759540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad4032d90 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.227+0000 7f8ade000640 1 -- 172.21.15.7:0/405759540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ad403b8d0 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.227+0000 7f8ade000640 1 -- 172.21.15.7:0/405759540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ad403a780 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.227+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae019bda0 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.227+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae019c240 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.228+0000 7f8ade000640 1 -- 172.21.15.7:0/405759540 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f8ad4039040 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.229+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae010bd50 con 0x7f8ae0107950 2024-09-13T18:07:32.096 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.229+0000 7f8ade000640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f8ac80384b0 0x7f8ac803a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.229+0000 7f8ade000640 1 -- 172.21.15.7:0/405759540 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8ad406b4b0 con 0x7f8ae0107950 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.229+0000 7f8ae4a00640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f8ac80384b0 0x7f8ac803a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.230+0000 7f8ae4a00640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f8ac80384b0 0x7f8ac803a970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0098c0 tx=0x7f8acc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.235+0000 7f8ade000640 1 -- 172.21.15.7:0/405759540 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8ad403bd90 con 0x7f8ae0107950 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.484+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8ae010bf90 con 0x7f8ae0107950 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.485+0000 7f8ade000640 1 -- 172.21.15.7:0/405759540 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f8ad403f4f0 con 0x7f8ae0107950 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.487+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f8ac80384b0 msgr2=0x7f8ac803a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.487+0000 7f8ae7e00640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f8ac80384b0 0x7f8ac803a970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0098c0 tx=0x7f8acc006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.487+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 msgr2=0x7f8ae019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.487+0000 7f8ae7e00640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae019b660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40097f0 tx=0x7f8ad4030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.488+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 shutdown_connections 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.488+0000 7f8ae7e00640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f8ac80384b0 0x7f8ac803a970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.488+0000 7f8ae7e00640 1 --2- 172.21.15.7:0/405759540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ae0107950 0x7f8ae019b660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.098 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.488+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 >> 172.21.15.7:0/405759540 conn(0x7f8ae007af00 msgr2=0x7f8ae0105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.098 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.488+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 shutdown_connections 2024-09-13T18:07:32.098 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:31.488+0000 7f8ae7e00640 1 -- 172.21.15.7:0/405759540 wait complete. 2024-09-13T18:07:32.098 INFO:teuthology.orchestra.run.smithi007.stdout:mgr is available 2024-09-13T18:07:32.360 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:32 smithi007 ceph-mon[30588]: mgrmap e3: x(active, since 1.0084s) 2024-09-13T18:07:32.360 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:32 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/405759540' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T18:07:33.454 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:33 smithi007 ceph-mon[30588]: mgrmap e4: x(active, since 2s) 2024-09-13T18:07:33.455 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:33 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1857152841' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T18:07:33.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T18:07:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bb4c00640 1 Processor -- start 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bb4c00640 1 -- start start 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bb4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb0107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bb4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0108320 con 0x7f5bb0107950 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb0107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb0107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40552/0 (socket says 172.21.15.7:40552) 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bade00640 1 -- 172.21.15.7:0/3704202940 learned_addr learned my addr 172.21.15.7:0/3704202940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:33.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.589+0000 7f5bade00640 1 -- 172.21.15.7:0/3704202940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0108b20 con 0x7f5bb0107950 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.590+0000 7f5bade00640 1 --2- 172.21.15.7:0/3704202940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb0107d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009820 tx=0x7f5ba002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8894b90b95b13ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.590+0000 7f5bad400640 1 -- 172.21.15.7:0/3704202940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ba002ae70 con 0x7f5bb0107950 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.590+0000 7f5bad400640 1 -- 172.21.15.7:0/3704202940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ba00328e0 con 0x7f5bb0107950 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.590+0000 7f5bad400640 1 -- 172.21.15.7:0/3704202940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ba00308c0 con 0x7f5bb0107950 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.591+0000 7f5bb4c00640 1 -- 172.21.15.7:0/3704202940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 msgr2=0x7f5bb0107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.591+0000 7f5bb4c00640 1 --2- 172.21.15.7:0/3704202940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb0107d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009820 tx=0x7f5ba002a270 comp rx=0 tx=0).stop 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.591+0000 7f5bb4c00640 1 -- 172.21.15.7:0/3704202940 shutdown_connections 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.591+0000 7f5bb4c00640 1 --2- 172.21.15.7:0/3704202940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb0107d50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.591+0000 7f5bb4c00640 1 -- 172.21.15.7:0/3704202940 >> 172.21.15.7:0/3704202940 conn(0x7f5bb007af00 msgr2=0x7f5bb007b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.591+0000 7f5bb4c00640 1 -- 172.21.15.7:0/3704202940 shutdown_connections 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.591+0000 7f5bb4c00640 1 -- 172.21.15.7:0/3704202940 wait complete. 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.592+0000 7f5bb4c00640 1 Processor -- start 2024-09-13T18:07:33.469 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.592+0000 7f5bb4c00640 1 -- start start 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.592+0000 7f5bb4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.593+0000 7f5bb4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb019bba0 con 0x7f5bb0107950 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.593+0000 7f5bade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.593+0000 7f5bade00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40556/0 (socket says 172.21.15.7:40556) 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.593+0000 7f5bade00640 1 -- 172.21.15.7:0/1857152841 learned_addr learned my addr 172.21.15.7:0/1857152841 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.593+0000 7f5bade00640 1 -- 172.21.15.7:0/1857152841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba00094d0 con 0x7f5bb0107950 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.593+0000 7f5bade00640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb019b660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00097f0 tx=0x7f5ba0030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.594+0000 7f5ba7400640 1 -- 172.21.15.7:0/1857152841 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ba0032d90 con 0x7f5bb0107950 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.594+0000 7f5ba7400640 1 -- 172.21.15.7:0/1857152841 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ba003b8d0 con 0x7f5bb0107950 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.594+0000 7f5bb4c00640 1 -- 172.21.15.7:0/1857152841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb019bda0 con 0x7f5bb0107950 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.594+0000 7f5ba7400640 1 -- 172.21.15.7:0/1857152841 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ba003a780 con 0x7f5bb0107950 2024-09-13T18:07:33.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.594+0000 7f5bb4c00640 1 -- 172.21.15.7:0/1857152841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb019c240 con 0x7f5bb0107950 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.595+0000 7f5ba7400640 1 -- 172.21.15.7:0/1857152841 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f5ba0039040 con 0x7f5bb0107950 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.595+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb010bd50 con 0x7f5bb0107950 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.595+0000 7f5ba7400640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f5b94038620 0x7f5b9403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.595+0000 7f5ba7400640 1 -- 172.21.15.7:0/1857152841 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5ba006b7a0 con 0x7f5bb0107950 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.596+0000 7f5ba5400640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f5b94038620 0x7f5b9403aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.596+0000 7f5ba5400640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f5b94038620 0x7f5b9403aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b980098c0 tx=0x7f5b98006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.600+0000 7f5ba7400640 1 -- 172.21.15.7:0/1857152841 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5ba003ba40 con 0x7f5bb0107950 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.780+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5bb010bf90 con 0x7f5bb0107950 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.782+0000 7f5ba7400640 1 -- 172.21.15.7:0/1857152841 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f5ba003f020 con 0x7f5bb0107950 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f5b94038620 msgr2=0x7f5b9403aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f5b94038620 0x7f5b9403aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b980098c0 tx=0x7f5b98006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 msgr2=0x7f5bb019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb019b660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00097f0 tx=0x7f5ba0030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 shutdown_connections 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f5b94038620 0x7f5b9403aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 --2- 172.21.15.7:0/1857152841 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb0107950 0x7f5bb019b660 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.784+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 >> 172.21.15.7:0/1857152841 conn(0x7f5bb007af00 msgr2=0x7f5bb0105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.785+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 shutdown_connections 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:32.785+0000 7f5b9fe00640 1 -- 172.21.15.7:0/1857152841 wait complete. 2024-09-13T18:07:33.472 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling cephadm module... 2024-09-13T18:07:34.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:34 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/219464156' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T18:07:34.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:34.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:34.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:34.530+0000 7ff307f75040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:07:34.880 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:34.603+0000 7ff307f75040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:07:34.880 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:34.795+0000 7ff307f75040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:07:34.880 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:34.877+0000 7ff307f75040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:07:34.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.997+0000 7f0a9be00640 1 Processor -- start 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.998+0000 7f0a9be00640 1 -- start start 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.998+0000 7f0a9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c107c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.998+0000 7f0a9be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c108200 con 0x7f0a9c107830 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.998+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.998+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54430/0 (socket says 172.21.15.7:54430) 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.998+0000 7f0a9aa00640 1 -- 172.21.15.7:0/3895949266 learned_addr learned my addr 172.21.15.7:0/3895949266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:33.999+0000 7f0a9aa00640 1 -- 172.21.15.7:0/3895949266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c108a20 con 0x7f0a9c107830 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.000+0000 7f0a9aa00640 1 --2- 172.21.15.7:0/3895949266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c107c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009820 tx=0x7f0a8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c4a8bf59362f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.000+0000 7f0a9a000640 1 -- 172.21.15.7:0/3895949266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c02ae70 con 0x7f0a9c107830 2024-09-13T18:07:34.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.000+0000 7f0a9a000640 1 -- 172.21.15.7:0/3895949266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a8c0328e0 con 0x7f0a9c107830 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.000+0000 7f0a9a000640 1 -- 172.21.15.7:0/3895949266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c0308c0 con 0x7f0a9c107830 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.001+0000 7f0a9be00640 1 -- 172.21.15.7:0/3895949266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 msgr2=0x7f0a9c107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.001+0000 7f0a9be00640 1 --2- 172.21.15.7:0/3895949266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c107c30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009820 tx=0x7f0a8c02a270 comp rx=0 tx=0).stop 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.001+0000 7f0a9be00640 1 -- 172.21.15.7:0/3895949266 shutdown_connections 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.001+0000 7f0a9be00640 1 --2- 172.21.15.7:0/3895949266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c107c30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.001+0000 7f0a9be00640 1 -- 172.21.15.7:0/3895949266 >> 172.21.15.7:0/3895949266 conn(0x7f0a9c07ae00 msgr2=0x7f0a9c07b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.001+0000 7f0a9be00640 1 -- 172.21.15.7:0/3895949266 shutdown_connections 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.001+0000 7f0a9be00640 1 -- 172.21.15.7:0/3895949266 wait complete. 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.002+0000 7f0a9be00640 1 Processor -- start 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.002+0000 7f0a9be00640 1 -- start start 2024-09-13T18:07:34.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.002+0000 7f0a9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.002+0000 7f0a9be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c19ba10 con 0x7f0a9c107830 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.002+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.002+0000 7f0a9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54438/0 (socket says 172.21.15.7:54438) 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.002+0000 7f0a9aa00640 1 -- 172.21.15.7:0/219464156 learned_addr learned my addr 172.21.15.7:0/219464156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.003+0000 7f0a9aa00640 1 -- 172.21.15.7:0/219464156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0094d0 con 0x7f0a9c107830 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.003+0000 7f0a9aa00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c19b4d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0097f0 tx=0x7f0a8c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.003+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c032d90 con 0x7f0a9c107830 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.003+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a8c03b8d0 con 0x7f0a9c107830 2024-09-13T18:07:34.959 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.003+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a8c03a780 con 0x7f0a9c107830 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.003+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c19bc10 con 0x7f0a9c107830 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.004+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c19c0b0 con 0x7f0a9c107830 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.005+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f0a8c039040 con 0x7f0a9c107830 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.005+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c10bc50 con 0x7f0a9c107830 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.005+0000 7f0aa0a00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f0a80038620 0x7f0a8003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.005+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0a8c06b650 con 0x7f0a9c107830 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.005+0000 7f0a93e00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f0a80038620 0x7f0a8003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.006+0000 7f0a93e00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f0a80038620 0x7f0a8003aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a840098c0 tx=0x7f0a84006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:34.960 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.010+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0a8c03bd90 con 0x7f0a9c107830 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.233+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f0a9c19e990 con 0x7f0a9c107830 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.286+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f0a8c03ba40 con 0x7f0a9c107830 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.288+0000 7f0aa0a00640 1 -- 172.21.15.7:0/219464156 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f0a8c06b070 con 0x7f0a9c107830 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f0a80038620 msgr2=0x7f0a8003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f0a80038620 0x7f0a8003aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a840098c0 tx=0x7f0a84006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 msgr2=0x7f0a9c19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c19b4d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0097f0 tx=0x7f0a8c030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 shutdown_connections 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f0a80038620 0x7f0a8003aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 --2- 172.21.15.7:0/219464156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a9c107830 0x7f0a9c19b4d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:34.961 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.291+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 >> 172.21.15.7:0/219464156 conn(0x7f0a9c07ae00 msgr2=0x7f0a9c1054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:34.962 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.292+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 shutdown_connections 2024-09-13T18:07:34.962 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:34.292+0000 7f0a9be00640 1 -- 172.21.15.7:0/219464156 wait complete. 2024-09-13T18:07:35.200 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:35.058+0000 7ff307f75040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:07:35.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:35 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/219464156' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T18:07:35.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:35 smithi007 ceph-mon[30588]: mgrmap e5: x(active, since 4s) 2024-09-13T18:07:35.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:35.238+0000 7ff307f75040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:07:35.921 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:35.618+0000 7ff307f75040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:07:35.921 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:35.696+0000 7ff307f75040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:07:35.921 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:35.918+0000 7ff307f75040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:07:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:07:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T18:07:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T18:07:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T18:07:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T18:07:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:07:36.359 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.419+0000 7fdc24200640 1 Processor -- start 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.419+0000 7fdc24200640 1 -- start start 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.420+0000 7fdc24200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.420+0000 7fdc24200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c108320 con 0x7fdc1c107950 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.420+0000 7fdc21800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.420+0000 7fdc21800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54462/0 (socket says 172.21.15.7:54462) 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.420+0000 7fdc21800640 1 -- 172.21.15.7:0/504853556 learned_addr learned my addr 172.21.15.7:0/504853556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.421+0000 7fdc21800640 1 -- 172.21.15.7:0/504853556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c108b20 con 0x7fdc1c107950 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.421+0000 7fdc21800640 1 --2- 172.21.15.7:0/504853556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c107d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009820 tx=0x7fdc1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f9873d22570bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.422+0000 7fdc1be00640 1 -- 172.21.15.7:0/504853556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc1002ae70 con 0x7fdc1c107950 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.422+0000 7fdc1be00640 1 -- 172.21.15.7:0/504853556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc100328e0 con 0x7fdc1c107950 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.422+0000 7fdc1be00640 1 -- 172.21.15.7:0/504853556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc100308c0 con 0x7fdc1c107950 2024-09-13T18:07:36.360 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.422+0000 7fdc24200640 1 -- 172.21.15.7:0/504853556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 msgr2=0x7fdc1c107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.422+0000 7fdc24200640 1 --2- 172.21.15.7:0/504853556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c107d50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009820 tx=0x7fdc1002a270 comp rx=0 tx=0).stop 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.423+0000 7fdc24200640 1 -- 172.21.15.7:0/504853556 shutdown_connections 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.423+0000 7fdc24200640 1 --2- 172.21.15.7:0/504853556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c107d50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.423+0000 7fdc24200640 1 -- 172.21.15.7:0/504853556 >> 172.21.15.7:0/504853556 conn(0x7fdc1c07af00 msgr2=0x7fdc1c07b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.423+0000 7fdc24200640 1 -- 172.21.15.7:0/504853556 shutdown_connections 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.423+0000 7fdc24200640 1 -- 172.21.15.7:0/504853556 wait complete. 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.424+0000 7fdc24200640 1 Processor -- start 2024-09-13T18:07:36.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.424+0000 7fdc24200640 1 -- start start 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.425+0000 7fdc24200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.425+0000 7fdc24200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c19bba0 con 0x7fdc1c107950 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.425+0000 7fdc21800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.425+0000 7fdc21800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54466/0 (socket says 172.21.15.7:54466) 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.425+0000 7fdc21800640 1 -- 172.21.15.7:0/2334492825 learned_addr learned my addr 172.21.15.7:0/2334492825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.425+0000 7fdc21800640 1 -- 172.21.15.7:0/2334492825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100094d0 con 0x7fdc1c107950 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.426+0000 7fdc21800640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c19b660 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc100097f0 tx=0x7fdc10030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.426+0000 7fdc1a000640 1 -- 172.21.15.7:0/2334492825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc10032d90 con 0x7fdc1c107950 2024-09-13T18:07:36.362 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.426+0000 7fdc1a000640 1 -- 172.21.15.7:0/2334492825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc1003b8d0 con 0x7fdc1c107950 2024-09-13T18:07:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.426+0000 7fdc1a000640 1 -- 172.21.15.7:0/2334492825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc1003a780 con 0x7fdc1c107950 2024-09-13T18:07:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.426+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c19bda0 con 0x7fdc1c107950 2024-09-13T18:07:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.426+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c19c240 con 0x7fdc1c107950 2024-09-13T18:07:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.427+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c10bd50 con 0x7fdc1c107950 2024-09-13T18:07:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.427+0000 7fdc1a000640 1 -- 172.21.15.7:0/2334492825 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fdc10039040 con 0x7fdc1c107950 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.428+0000 7fdc1a000640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 0x7fdc0403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.428+0000 7fdc1a000640 1 -- 172.21.15.7:0/2334492825 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdc1006b740 con 0x7fdc1c107950 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.428+0000 7fdc20e00640 1 -- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 msgr2=0x7fdc0403aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/568921109 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.428+0000 7fdc20e00640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 0x7fdc0403aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.433+0000 7fdc1a000640 1 -- 172.21.15.7:0/2334492825 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdc1003bd90 con 0x7fdc1c107950 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.629+0000 7fdc20e00640 1 -- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 msgr2=0x7fdc0403aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/568921109 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.629+0000 7fdc20e00640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 0x7fdc0403aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.660+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fdc1c19ef20 con 0x7fdc1c107950 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.660+0000 7fdc1a000640 1 -- 172.21.15.7:0/2334492825 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fdc1003f070 con 0x7fdc1c107950 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 msgr2=0x7fdc0403aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 0x7fdc0403aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.364 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 msgr2=0x7fdc1c19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c19b660 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc100097f0 tx=0x7fdc10030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 shutdown_connections 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7fdc04038620 0x7fdc0403aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 --2- 172.21.15.7:0/2334492825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc1c107950 0x7fdc1c19b660 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 >> 172.21.15.7:0/2334492825 conn(0x7fdc1c07af00 msgr2=0x7fdc1c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 shutdown_connections 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:35.664+0000 7fdc24200640 1 -- 172.21.15.7:0/2334492825 wait complete. 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-13T18:07:36.365 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 5... 2024-09-13T18:07:36.636 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:36 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2334492825' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T18:07:37.147 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:37.062+0000 7ff307f75040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:07:37.147 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:37.144+0000 7ff307f75040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:07:38.414 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:38.102+0000 7ff307f75040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:07:38.414 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:38.242+0000 7ff307f75040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:07:38.414 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:38.411+0000 7ff307f75040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:07:38.747 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:38.486+0000 7ff307f75040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:07:38.747 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:38.661+0000 7ff307f75040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:07:38.748 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:38.745+0000 7ff307f75040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:07:39.006 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:38.818+0000 7ff307f75040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:07:39.007 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:39.004+0000 7ff307f75040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:07:39.268 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:39.083+0000 7ff307f75040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:07:39.268 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:39.165+0000 7ff307f75040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:07:39.268 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:39.265+0000 7ff307f75040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:07:39.540 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:39.338+0000 7ff307f75040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:07:39.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:39.410+0000 7ff307f75040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:07:40.790 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:40.347+0000 7ff307f75040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: Active manager daemon x restarted 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: Activating manager daemon x 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: mgrmap e6: x(active, starting, since 0.00428658s) 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:07:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:07:40.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:07:40.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: Manager daemon x is now available 2024-09-13T18:07:40.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:40.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:40.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:07:40.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:40 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:07:41.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:41 smithi007 ceph-mon[30588]: Found migration_current of "None". Setting to last migration. 2024-09-13T18:07:41.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:41 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:07:41.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:41 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T18:07:41.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:41 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:41.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:41 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:41.690 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:41 smithi007 ceph-mon[30588]: mgrmap e7: x(active, since 1.00649s) 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.879+0000 7f4e52600640 1 Processor -- start 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.879+0000 7f4e52600640 1 -- start start 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.879+0000 7f4e52600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:41.973 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.879+0000 7f4e52600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c108320 con 0x7f4e4c107950 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.880+0000 7f4e4b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.880+0000 7f4e4b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54474/0 (socket says 172.21.15.7:54474) 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.880+0000 7f4e4b400640 1 -- 172.21.15.7:0/2976586907 learned_addr learned my addr 172.21.15.7:0/2976586907 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.880+0000 7f4e4b400640 1 -- 172.21.15.7:0/2976586907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c108b20 con 0x7f4e4c107950 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.881+0000 7f4e4b400640 1 --2- 172.21.15.7:0/2976586907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c107d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009820 tx=0x7f4e3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ddd970b867c0e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.881+0000 7f4e4a000640 1 -- 172.21.15.7:0/2976586907 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c02ae70 con 0x7f4e4c107950 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.881+0000 7f4e4a000640 1 -- 172.21.15.7:0/2976586907 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e3c0328e0 con 0x7f4e4c107950 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.881+0000 7f4e4a000640 1 -- 172.21.15.7:0/2976586907 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c0308c0 con 0x7f4e4c107950 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.882+0000 7f4e52600640 1 -- 172.21.15.7:0/2976586907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 msgr2=0x7f4e4c107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.882+0000 7f4e52600640 1 --2- 172.21.15.7:0/2976586907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c107d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009820 tx=0x7f4e3c02a270 comp rx=0 tx=0).stop 2024-09-13T18:07:41.974 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.882+0000 7f4e52600640 1 -- 172.21.15.7:0/2976586907 shutdown_connections 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.882+0000 7f4e52600640 1 --2- 172.21.15.7:0/2976586907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c107d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.882+0000 7f4e52600640 1 -- 172.21.15.7:0/2976586907 >> 172.21.15.7:0/2976586907 conn(0x7f4e4c07af00 msgr2=0x7f4e4c07b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.882+0000 7f4e52600640 1 -- 172.21.15.7:0/2976586907 shutdown_connections 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.882+0000 7f4e52600640 1 -- 172.21.15.7:0/2976586907 wait complete. 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.883+0000 7f4e52600640 1 Processor -- start 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.883+0000 7f4e52600640 1 -- start start 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.884+0000 7f4e52600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.884+0000 7f4e52600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c19bba0 con 0x7f4e4c107950 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.884+0000 7f4e4b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.884+0000 7f4e4b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54486/0 (socket says 172.21.15.7:54486) 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.884+0000 7f4e4b400640 1 -- 172.21.15.7:0/1226583770 learned_addr learned my addr 172.21.15.7:0/1226583770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.884+0000 7f4e4b400640 1 -- 172.21.15.7:0/1226583770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0094d0 con 0x7f4e4c107950 2024-09-13T18:07:41.975 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.885+0000 7f4e4b400640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c19b660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0097f0 tx=0x7f4e3c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.885+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c032d90 con 0x7f4e4c107950 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.885+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e3c03b8d0 con 0x7f4e4c107950 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.885+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c19bda0 con 0x7f4e4c107950 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.885+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e3c03a780 con 0x7f4e4c107950 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.885+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c19c240 con 0x7f4e4c107950 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.887+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f4e3c039040 con 0x7f4e4c107950 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.887+0000 7f4e43e00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.887+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 --> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e3003b240 con 0x7f4e30038670 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.888+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4e3c06b6b0 con 0x7f4e4c107950 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.888+0000 7f4e4aa00640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 msgr2=0x7f4e3003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/568921109 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:36.888+0000 7f4e4aa00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:37.089+0000 7f4e4aa00640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 msgr2=0x7f4e3003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/568921109 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:37.089+0000 7f4e4aa00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:07:41.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:37.490+0000 7f4e4aa00640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 msgr2=0x7f4e3003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/568921109 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:37.490+0000 7f4e4aa00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:38.291+0000 7f4e4aa00640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 msgr2=0x7f4e3003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/568921109 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:38.291+0000 7f4e4aa00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:39.892+0000 7f4e4aa00640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 msgr2=0x7f4e3003ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/568921109 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:39.892+0000 7f4e4aa00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:40.352+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7f4e3c049c40 con 0x7f4e4c107950 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:40.352+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 msgr2=0x7f4e3003ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:40.352+0000 7f4e43e00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.353+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f4e3c06d2b0 con 0x7f4e4c107950 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.354+0000 7f4e43e00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f4e3003bf50 0x7f4e3003e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.354+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e3003b240 con 0x7f4e3003bf50 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.355+0000 7f4e4aa00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f4e3003bf50 0x7f4e3003e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:41.977 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.356+0000 7f4e4aa00640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f4e3003bf50 0x7f4e3003e340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4e38003980 tx=0x7f4e380092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.357+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f4e3003b240 con 0x7f4e3003bf50 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.363+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f4e2c0025a0 con 0x7f4e3003bf50 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.363+0000 7f4e43e00640 1 -- 172.21.15.7:0/1226583770 <== mgr.14118 v2:172.21.15.7:6800/3391098565 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f4e2c0025a0 con 0x7f4e3003bf50 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f4e3003bf50 msgr2=0x7f4e3003e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f4e3003bf50 0x7f4e3003e340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4e38003980 tx=0x7f4e380092b0 comp rx=0 tx=0).stop 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 msgr2=0x7f4e4c19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c19b660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0097f0 tx=0x7f4e3c030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 shutdown_connections 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f4e3003bf50 0x7f4e3003e340 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:6800/568921109,v1:172.21.15.7:6801/568921109] conn(0x7f4e30038670 0x7f4e3003ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 --2- 172.21.15.7:0/1226583770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e4c107950 0x7f4e4c19b660 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 >> 172.21.15.7:0/1226583770 conn(0x7f4e4c07af00 msgr2=0x7f4e4c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:41.978 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 shutdown_connections 2024-09-13T18:07:41.979 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:41.364+0000 7f4e52600640 1 -- 172.21.15.7:0/1226583770 wait complete. 2024-09-13T18:07:41.979 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 5 is available 2024-09-13T18:07:41.979 INFO:teuthology.orchestra.run.smithi007.stdout:Setting orchestrator backend to cephadm... 2024-09-13T18:07:42.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-mon[30588]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T18:07:42.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-mon[30588]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T18:07:42.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:42.476+0000 7ff267400640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:18:07:42] ENGINE Error in HTTPServer.serve 2024-09-13T18:07:42.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: Traceback (most recent call last): 2024-09-13T18:07:42.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:07:42.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self._connections.run(self.expiration_interval) 2024-09-13T18:07:42.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self._run(expiration_interval) 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: s = self.context.wrap_socket( 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: return self.sslsocket_class._create( 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self.do_handshake() 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self._sslobj.do_handshake() 2024-09-13T18:07:42.542 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:07:42.543 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:07:43.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.487+0000 7f8b50a00640 1 Processor -- start 2024-09-13T18:07:43.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.487+0000 7f8b50a00640 1 -- start start 2024-09-13T18:07:43.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.487+0000 7f8b50a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c105b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:43.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.487+0000 7f8b50a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c106120 con 0x7f8b4c105750 2024-09-13T18:07:43.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.488+0000 7f8b49e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c105b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:43.310 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.488+0000 7f8b49e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c105b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54566/0 (socket says 172.21.15.7:54566) 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.488+0000 7f8b49e00640 1 -- 172.21.15.7:0/3730619480 learned_addr learned my addr 172.21.15.7:0/3730619480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.488+0000 7f8b49e00640 1 -- 172.21.15.7:0/3730619480 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c106950 con 0x7f8b4c105750 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.489+0000 7f8b49e00640 1 --2- 172.21.15.7:0/3730619480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c105b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009820 tx=0x7f8b3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce070215241abce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.489+0000 7f8b48a00640 1 -- 172.21.15.7:0/3730619480 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b3c02ae70 con 0x7f8b4c105750 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.489+0000 7f8b48a00640 1 -- 172.21.15.7:0/3730619480 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b3c0328e0 con 0x7f8b4c105750 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.489+0000 7f8b48a00640 1 -- 172.21.15.7:0/3730619480 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b3c0308c0 con 0x7f8b4c105750 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.490+0000 7f8b50a00640 1 -- 172.21.15.7:0/3730619480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 msgr2=0x7f8b4c105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.490+0000 7f8b50a00640 1 --2- 172.21.15.7:0/3730619480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c105b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009820 tx=0x7f8b3c02a270 comp rx=0 tx=0).stop 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.490+0000 7f8b50a00640 1 -- 172.21.15.7:0/3730619480 shutdown_connections 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.490+0000 7f8b50a00640 1 --2- 172.21.15.7:0/3730619480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c105b50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.490+0000 7f8b50a00640 1 -- 172.21.15.7:0/3730619480 >> 172.21.15.7:0/3730619480 conn(0x7f8b4c100fa0 msgr2=0x7f8b4c1033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.490+0000 7f8b50a00640 1 -- 172.21.15.7:0/3730619480 shutdown_connections 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.490+0000 7f8b50a00640 1 -- 172.21.15.7:0/3730619480 wait complete. 2024-09-13T18:07:43.311 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.491+0000 7f8b50a00640 1 Processor -- start 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.491+0000 7f8b50a00640 1 -- start start 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.492+0000 7f8b50a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c07bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.492+0000 7f8b50a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c07c070 con 0x7f8b4c105750 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.492+0000 7f8b49e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c07bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.492+0000 7f8b49e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c07bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54582/0 (socket says 172.21.15.7:54582) 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.492+0000 7f8b49e00640 1 -- 172.21.15.7:0/4044205763 learned_addr learned my addr 172.21.15.7:0/4044205763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.492+0000 7f8b49e00640 1 -- 172.21.15.7:0/4044205763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0094d0 con 0x7f8b4c105750 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.492+0000 7f8b49e00640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c07bb30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0097f0 tx=0x7f8b3c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.493+0000 7f8b42a00640 1 -- 172.21.15.7:0/4044205763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b3c032d90 con 0x7f8b4c105750 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.493+0000 7f8b42a00640 1 -- 172.21.15.7:0/4044205763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b3c03b8d0 con 0x7f8b4c105750 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.493+0000 7f8b42a00640 1 -- 172.21.15.7:0/4044205763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b3c03a780 con 0x7f8b4c105750 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.493+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c07a260 con 0x7f8b4c105750 2024-09-13T18:07:43.312 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.493+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c07a700 con 0x7f8b4c105750 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.494+0000 7f8b42a00640 1 -- 172.21.15.7:0/4044205763 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f8b3c039040 con 0x7f8b4c105750 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.494+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c109b80 con 0x7f8b4c105750 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.494+0000 7f8b42a00640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f8b300386c0 0x7f8b3003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.494+0000 7f8b42a00640 1 -- 172.21.15.7:0/4044205763 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8b3c06b7c0 con 0x7f8b4c105750 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.495+0000 7f8b49400640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f8b300386c0 0x7f8b3003ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.495+0000 7f8b49400640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f8b300386c0 0x7f8b3003ab80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098c0 tx=0x7f8b38006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.500+0000 7f8b42a00640 1 -- 172.21.15.7:0/4044205763 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8b3c0313a0 con 0x7f8b4c105750 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.698+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b4c07ae60 con 0x7f8b300386c0 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.707+0000 7f8b42a00640 1 -- 172.21.15.7:0/4044205763 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8b4c07ae60 con 0x7f8b300386c0 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.709+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f8b300386c0 msgr2=0x7f8b3003ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.709+0000 7f8b50a00640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f8b300386c0 0x7f8b3003ab80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098c0 tx=0x7f8b38006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:43.313 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.709+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 msgr2=0x7f8b4c07bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.709+0000 7f8b50a00640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c07bb30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0097f0 tx=0x7f8b3c030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.710+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 shutdown_connections 2024-09-13T18:07:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.710+0000 7f8b50a00640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f8b300386c0 0x7f8b3003ab80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.710+0000 7f8b50a00640 1 --2- 172.21.15.7:0/4044205763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b4c105750 0x7f8b4c07bb30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.710+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 >> 172.21.15.7:0/4044205763 conn(0x7f8b4c100fa0 msgr2=0x7f8b4c101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.710+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 shutdown_connections 2024-09-13T18:07:43.314 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:42.710+0000 7f8b50a00640 1 -- 172.21.15.7:0/4044205763 wait complete. 2024-09-13T18:07:43.554 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:43 smithi007 ceph-mon[30588]: [13/Sep/2024:18:07:42] ENGINE Bus STARTING 2024-09-13T18:07:43.554 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:43 smithi007 ceph-mon[30588]: mgrmap e8: x(active, since 2s) 2024-09-13T18:07:43.554 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:43 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:07:43.555 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:43 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:43.555 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:43 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:44 smithi007 ceph-mon[30588]: [13/Sep/2024:18:07:42] ENGINE Serving on https://172.21.15.7:7150 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:44 smithi007 ceph-mon[30588]: [13/Sep/2024:18:07:42] ENGINE Error in HTTPServer.serve 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:07:44.564 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:44 smithi007 ceph-mon[30588]: [13/Sep/2024:18:07:42] ENGINE Serving on http://172.21.15.7:8765 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:44 smithi007 ceph-mon[30588]: [13/Sep/2024:18:07:42] ENGINE Bus STARTED 2024-09-13T18:07:44.565 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:44 smithi007 ceph-mon[30588]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:07:44.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T18:07:44.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.766+0000 7ff8b6800640 1 Processor -- start 2024-09-13T18:07:44.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.766+0000 7ff8b6800640 1 -- start start 2024-09-13T18:07:44.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.766+0000 7ff8b6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b0107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:44.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.766+0000 7ff8b6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b0108320 con 0x7ff8b0107950 2024-09-13T18:07:44.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.766+0000 7ff8af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b0107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:44.576 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.767+0000 7ff8af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b0107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54596/0 (socket says 172.21.15.7:54596) 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.767+0000 7ff8af400640 1 -- 172.21.15.7:0/3436618753 learned_addr learned my addr 172.21.15.7:0/3436618753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.767+0000 7ff8af400640 1 -- 172.21.15.7:0/3436618753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0108b50 con 0x7ff8b0107950 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.768+0000 7ff8af400640 1 --2- 172.21.15.7:0/3436618753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b0107d50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009e80 tx=0x7ff8a002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b857133dd8071433 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.768+0000 7ff8aea00640 1 -- 172.21.15.7:0/3436618753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8a0031400 con 0x7ff8b0107950 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.768+0000 7ff8aea00640 1 -- 172.21.15.7:0/3436618753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8a002d050 con 0x7ff8b0107950 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.768+0000 7ff8aea00640 1 -- 172.21.15.7:0/3436618753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8a0007960 con 0x7ff8b0107950 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.769+0000 7ff8b6800640 1 -- 172.21.15.7:0/3436618753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 msgr2=0x7ff8b0107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.769+0000 7ff8b6800640 1 --2- 172.21.15.7:0/3436618753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b0107d50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009e80 tx=0x7ff8a002a7a0 comp rx=0 tx=0).stop 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.769+0000 7ff8b6800640 1 -- 172.21.15.7:0/3436618753 shutdown_connections 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.769+0000 7ff8b6800640 1 --2- 172.21.15.7:0/3436618753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b0107d50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.769+0000 7ff8b6800640 1 -- 172.21.15.7:0/3436618753 >> 172.21.15.7:0/3436618753 conn(0x7ff8b007af30 msgr2=0x7ff8b007b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.769+0000 7ff8b6800640 1 -- 172.21.15.7:0/3436618753 shutdown_connections 2024-09-13T18:07:44.577 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.769+0000 7ff8b6800640 1 -- 172.21.15.7:0/3436618753 wait complete. 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.770+0000 7ff8b6800640 1 Processor -- start 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.770+0000 7ff8b6800640 1 -- start start 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.770+0000 7ff8b6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b019b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.770+0000 7ff8b6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b019bb30 con 0x7ff8b0107950 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.770+0000 7ff8af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b019b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.770+0000 7ff8af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b019b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54600/0 (socket says 172.21.15.7:54600) 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.770+0000 7ff8af400640 1 -- 172.21.15.7:0/1692170901 learned_addr learned my addr 172.21.15.7:0/1692170901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.771+0000 7ff8af400640 1 -- 172.21.15.7:0/1692170901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0009b30 con 0x7ff8b0107950 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.771+0000 7ff8af400640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b019b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8a002acc0 tx=0x7ff8a0007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.771+0000 7ff8acc00640 1 -- 172.21.15.7:0/1692170901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8a0031de0 con 0x7ff8b0107950 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.771+0000 7ff8acc00640 1 -- 172.21.15.7:0/1692170901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8a003b8b0 con 0x7ff8b0107950 2024-09-13T18:07:44.578 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.771+0000 7ff8acc00640 1 -- 172.21.15.7:0/1692170901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8a003a920 con 0x7ff8b0107950 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.771+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b019bd30 con 0x7ff8b0107950 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.772+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b019c1d0 con 0x7ff8b0107950 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.773+0000 7ff8acc00640 1 -- 172.21.15.7:0/1692170901 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ff8a0038050 con 0x7ff8b0107950 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.773+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b010bd80 con 0x7ff8b0107950 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.773+0000 7ff8acc00640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7ff894038670 0x7ff89403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.773+0000 7ff8acc00640 1 -- 172.21.15.7:0/1692170901 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff8a006b9e0 con 0x7ff8b0107950 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.773+0000 7ff8a6a00640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7ff894038670 0x7ff89403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.774+0000 7ff8a6a00640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7ff894038670 0x7ff89403ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8980098c0 tx=0x7ff898006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.778+0000 7ff8acc00640 1 -- 172.21.15.7:0/1692170901 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff8a003bd90 con 0x7ff8b0107950 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.958+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8b0105b70 con 0x7ff894038670 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.959+0000 7ff8acc00640 1 -- 172.21.15.7:0/1692170901 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff8b0105b70 con 0x7ff894038670 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7ff894038670 msgr2=0x7ff89403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:44.579 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7ff894038670 0x7ff89403ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8980098c0 tx=0x7ff898006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 msgr2=0x7ff8b019b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b019b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8a002acc0 tx=0x7ff8a0007630 comp rx=0 tx=0).stop 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 shutdown_connections 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7ff894038670 0x7ff89403ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 --2- 172.21.15.7:0/1692170901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8b0107950 0x7ff8b019b5f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 >> 172.21.15.7:0/1692170901 conn(0x7ff8b007af30 msgr2=0x7ff8b0105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 shutdown_connections 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:43.962+0000 7ff8b6800640 1 -- 172.21.15.7:0/1692170901 wait complete. 2024-09-13T18:07:44.580 INFO:teuthology.orchestra.run.smithi007.stdout:Generating ssh key... 2024-09-13T18:07:45.515 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-mon[30588]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:07:45.515 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-mon[30588]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:07:45.515 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-mon[30588]: Generating ssh key... 2024-09-13T18:07:45.778 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: Generating public/private rsa key pair. 2024-09-13T18:07:45.778 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: Your identification has been saved in /tmp/tmpekhl_uur/key 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: Your public key has been saved in /tmp/tmpekhl_uur/key.pub 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: The key fingerprint is: 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: SHA256:GnLPaekI9dVeljhdo8/2Nh61DXW8JHVo6lgjkIQqCrA ceph-d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: The key's randomart image is: 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: +---[RSA 3072]----+ 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: | o.. o.| 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: |. . o +..| 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: |.. . . + o=| 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: |E . . ..+o+++| 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: |.. .. + S .=+o*..| 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: |. + * +...+o.+| 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: | . . B . *.| 2024-09-13T18:07:45.779 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: | . + ..+| 2024-09-13T18:07:45.780 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: | . . .oo| 2024-09-13T18:07:45.780 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:07:45 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: +----[SHA256]-----+ 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.029+0000 7f7f82800640 1 Processor -- start 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.029+0000 7f7f82800640 1 -- start start 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.029+0000 7f7f82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c07a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.029+0000 7f7f82800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c07a8b0 con 0x7f7f7c07be80 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.029+0000 7f7f7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c07a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.029+0000 7f7f7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c07a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50902/0 (socket says 172.21.15.7:50902) 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.029+0000 7f7f7b400640 1 -- 172.21.15.7:0/1082114711 learned_addr learned my addr 172.21.15.7:0/1082114711 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.030+0000 7f7f7b400640 1 -- 172.21.15.7:0/1082114711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c07a9f0 con 0x7f7f7c07be80 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.031+0000 7f7f7b400640 1 --2- 172.21.15.7:0/1082114711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c07a2e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009820 tx=0x7f7f6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7572d2cc35115555 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:46.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.031+0000 7f7f7aa00640 1 -- 172.21.15.7:0/1082114711 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c02ae70 con 0x7f7f7c07be80 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.031+0000 7f7f7aa00640 1 -- 172.21.15.7:0/1082114711 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f6c0328e0 con 0x7f7f7c07be80 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.031+0000 7f7f7aa00640 1 -- 172.21.15.7:0/1082114711 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c0308c0 con 0x7f7f7c07be80 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.032+0000 7f7f82800640 1 -- 172.21.15.7:0/1082114711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 msgr2=0x7f7f7c07a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.032+0000 7f7f82800640 1 --2- 172.21.15.7:0/1082114711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c07a2e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009820 tx=0x7f7f6c02a270 comp rx=0 tx=0).stop 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.032+0000 7f7f82800640 1 -- 172.21.15.7:0/1082114711 shutdown_connections 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.032+0000 7f7f82800640 1 --2- 172.21.15.7:0/1082114711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c07a2e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.032+0000 7f7f82800640 1 -- 172.21.15.7:0/1082114711 >> 172.21.15.7:0/1082114711 conn(0x7f7f7c100ec0 msgr2=0x7f7f7c103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.032+0000 7f7f82800640 1 -- 172.21.15.7:0/1082114711 shutdown_connections 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.032+0000 7f7f82800640 1 -- 172.21.15.7:0/1082114711 wait complete. 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.033+0000 7f7f82800640 1 Processor -- start 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.033+0000 7f7f82800640 1 -- start start 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.033+0000 7f7f82800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:46.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.033+0000 7f7f82800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c19bbc0 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.033+0000 7f7f7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.033+0000 7f7f7b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50908/0 (socket says 172.21.15.7:50908) 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.033+0000 7f7f7b400640 1 -- 172.21.15.7:0/3415195430 learned_addr learned my addr 172.21.15.7:0/3415195430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.034+0000 7f7f7b400640 1 -- 172.21.15.7:0/3415195430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0094d0 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.034+0000 7f7f7b400640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c19b680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0097f0 tx=0x7f7f6c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.034+0000 7f7f78c00640 1 -- 172.21.15.7:0/3415195430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c032d90 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.034+0000 7f7f78c00640 1 -- 172.21.15.7:0/3415195430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f6c03b8d0 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.034+0000 7f7f78c00640 1 -- 172.21.15.7:0/3415195430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c03a780 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.034+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c19bdc0 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.035+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c19c260 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.036+0000 7f7f78c00640 1 -- 172.21.15.7:0/3415195430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f7f6c039040 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.036+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c10bb40 con 0x7f7f7c07be80 2024-09-13T18:07:46.060 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.036+0000 7f7f78c00640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f7f60038670 0x7f7f6003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.036+0000 7f7f78c00640 1 -- 172.21.15.7:0/3415195430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7f6c06b790 con 0x7f7f7c07be80 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.036+0000 7f7f73e00640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f7f60038670 0x7f7f6003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.037+0000 7f7f73e00640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f7f60038670 0x7f7f6003ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7f640098c0 tx=0x7f7f64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.041+0000 7f7f78c00640 1 -- 172.21.15.7:0/3415195430 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7f6c03ba40 con 0x7f7f7c07be80 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.220+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f7c102190 con 0x7f7f60038670 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.520+0000 7f7f78c00640 1 -- 172.21.15.7:0/3415195430 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7f7c102190 con 0x7f7f60038670 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f7f60038670 msgr2=0x7f7f6003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f7f60038670 0x7f7f6003ab30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7f640098c0 tx=0x7f7f64006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 msgr2=0x7f7f7c19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c19b680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0097f0 tx=0x7f7f6c030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 shutdown_connections 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f7f60038670 0x7f7f6003ab30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:46.061 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 --2- 172.21.15.7:0/3415195430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7f7c07be80 0x7f7f7c19b680 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:46.062 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.522+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 >> 172.21.15.7:0/3415195430 conn(0x7f7f7c100ec0 msgr2=0x7f7f7c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:46.062 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.523+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 shutdown_connections 2024-09-13T18:07:46.062 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:45.523+0000 7f7f82800640 1 -- 172.21.15.7:0/3415195430 wait complete. 2024-09-13T18:07:46.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:46 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:46.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:46 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2kzuTLXTri3cf7lk8Ycd/S/36SEJjfqS2m7hFmEIGHNWbJV8Ozni1IPoSYXjwDY7xlFeP6pnPOZ5fQsf6CpL9gzzmLUwPhlGR+AjcLvIPrsbT1ytjXS5BX4vDED3UJG88vbD/wWgCWxIwUHec+eBER1CoUom4nql7B2b0ZjtLKDIKL+Y7D1TMYiAcyTtolsl4KRFYSwbUG8HwlXuV33ZdAQM/y+o///qcJETQ/EiRZIyU5tAkNdseLsB3eTPSlx2qx8GBYNlM+3ZWOP8US/JZw1LK7uBYFG9sX7sa6v5EcHj5Ld59YVKlJsgjko42ypuv1mYG0APY9oXl9LRgtZDlA+rm2AAUKINM04JiE2goFZ3/MQwW7Nd9HbiHOt6/l2OmSU1dw6/KQOy4qCErtlvrmC+N/Jc6VCzNQxJvCNbz32pelpKycLtpSbL5YC9yXxmz+R6+xQnyGweZ8spMQix0WgecRqVikgoWv2ZFi/6q4we0hFitLqLqNUqJmqpCQYk= ceph-d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.544+0000 7faf21200640 1 Processor -- start 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.544+0000 7faf21200640 1 -- start start 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.544+0000 7faf21200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c07a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.544+0000 7faf21200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c07a870 con 0x7faf1c07be40 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.544+0000 7faf1b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c07a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.544+0000 7faf1b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c07a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50910/0 (socket says 172.21.15.7:50910) 2024-09-13T18:07:47.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.544+0000 7faf1b400640 1 -- 172.21.15.7:0/1497928169 learned_addr learned my addr 172.21.15.7:0/1497928169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.545+0000 7faf1b400640 1 -- 172.21.15.7:0/1497928169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c07a9b0 con 0x7faf1c07be40 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.546+0000 7faf1b400640 1 --2- 172.21.15.7:0/1497928169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c07a2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009e80 tx=0x7faf0c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac284924611a6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.546+0000 7faf1aa00640 1 -- 172.21.15.7:0/1497928169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c031400 con 0x7faf1c07be40 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.546+0000 7faf1aa00640 1 -- 172.21.15.7:0/1497928169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faf0c02d050 con 0x7faf1c07be40 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.546+0000 7faf1aa00640 1 -- 172.21.15.7:0/1497928169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c007960 con 0x7faf1c07be40 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.547+0000 7faf21200640 1 -- 172.21.15.7:0/1497928169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 msgr2=0x7faf1c07a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.547+0000 7faf21200640 1 --2- 172.21.15.7:0/1497928169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c07a2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009e80 tx=0x7faf0c02a7a0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.547+0000 7faf21200640 1 -- 172.21.15.7:0/1497928169 shutdown_connections 2024-09-13T18:07:47.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.547+0000 7faf21200640 1 --2- 172.21.15.7:0/1497928169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c07a2a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.547+0000 7faf21200640 1 -- 172.21.15.7:0/1497928169 >> 172.21.15.7:0/1497928169 conn(0x7faf1c100cb0 msgr2=0x7faf1c1030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.547+0000 7faf21200640 1 -- 172.21.15.7:0/1497928169 shutdown_connections 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.547+0000 7faf21200640 1 -- 172.21.15.7:0/1497928169 wait complete. 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.548+0000 7faf21200640 1 Processor -- start 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.548+0000 7faf21200640 1 -- start start 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.548+0000 7faf21200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.548+0000 7faf21200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c19b8f0 con 0x7faf1c07be40 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.549+0000 7faf1b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.549+0000 7faf1b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c19b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50912/0 (socket says 172.21.15.7:50912) 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.549+0000 7faf1b400640 1 -- 172.21.15.7:0/3163294806 learned_addr learned my addr 172.21.15.7:0/3163294806 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.549+0000 7faf1b400640 1 -- 172.21.15.7:0/3163294806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c009b30 con 0x7faf1c07be40 2024-09-13T18:07:47.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.549+0000 7faf1b400640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c19b3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf0c02acc0 tx=0x7faf0c007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.550+0000 7faf18c00640 1 -- 172.21.15.7:0/3163294806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c031e10 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.550+0000 7faf18c00640 1 -- 172.21.15.7:0/3163294806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faf0c03b8b0 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.550+0000 7faf18c00640 1 -- 172.21.15.7:0/3163294806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0c03a960 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.550+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1c19baf0 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.550+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c19bf90 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.551+0000 7faf18c00640 1 -- 172.21.15.7:0/3163294806 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7faf0c038050 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.551+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c10b8f0 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.551+0000 7faf18c00640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7faf00038670 0x7faf0003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.551+0000 7faf18c00640 1 -- 172.21.15.7:0/3163294806 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7faf0c06b950 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.552+0000 7faf12a00640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7faf00038670 0x7faf0003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.552+0000 7faf12a00640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7faf00038670 0x7faf0003ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faf040098c0 tx=0x7faf04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.557+0000 7faf18c00640 1 -- 172.21.15.7:0/3163294806 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faf0c03bd90 con 0x7faf1c07be40 2024-09-13T18:07:47.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.737+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7faf1c101ef0 con 0x7faf00038670 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.738+0000 7faf18c00640 1 -- 172.21.15.7:0/3163294806 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7faf1c101ef0 con 0x7faf00038670 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7faf00038670 msgr2=0x7faf0003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7faf00038670 0x7faf0003ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faf040098c0 tx=0x7faf04006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 msgr2=0x7faf1c19b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c19b3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf0c02acc0 tx=0x7faf0c007630 comp rx=0 tx=0).stop 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 shutdown_connections 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7faf00038670 0x7faf0003ab30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 --2- 172.21.15.7:0/3163294806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf1c07be40 0x7faf1c19b3b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 >> 172.21.15.7:0/3163294806 conn(0x7faf1c100cb0 msgr2=0x7faf1c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 shutdown_connections 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:46.740+0000 7faf21200640 1 -- 172.21.15.7:0/3163294806 wait complete. 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:07:47.451 INFO:teuthology.orchestra.run.smithi007.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T18:07:47.452 INFO:teuthology.orchestra.run.smithi007.stdout:Adding host smithi007... 2024-09-13T18:07:47.730 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:47 smithi007 ceph-mon[30588]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:07:48.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:48 smithi007 ceph-mon[30588]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:07:50.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:50 smithi007 ceph-mon[30588]: Deploying cephadm binary to smithi007 2024-09-13T18:07:52.773 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Added host 'smithi007' with addr '172.21.15.7' 2024-09-13T18:07:52.773 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.953+0000 7fa953000640 1 Processor -- start 2024-09-13T18:07:52.773 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.953+0000 7fa953000640 1 -- start start 2024-09-13T18:07:52.773 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.953+0000 7fa953000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:52.773 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.954+0000 7fa953000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c108320 con 0x7fa94c107950 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.954+0000 7fa94be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.954+0000 7fa94be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50914/0 (socket says 172.21.15.7:50914) 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.954+0000 7fa94be00640 1 -- 172.21.15.7:0/4009295085 learned_addr learned my addr 172.21.15.7:0/4009295085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.954+0000 7fa94be00640 1 -- 172.21.15.7:0/4009295085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c108b50 con 0x7fa94c107950 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.955+0000 7fa94be00640 1 --2- 172.21.15.7:0/4009295085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c107d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009820 tx=0x7fa93c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38847cd7a22f5bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.955+0000 7fa94b400640 1 -- 172.21.15.7:0/4009295085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c02ae70 con 0x7fa94c107950 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa94b400640 1 -- 172.21.15.7:0/4009295085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa93c0328e0 con 0x7fa94c107950 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa94b400640 1 -- 172.21.15.7:0/4009295085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c0308c0 con 0x7fa94c107950 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa953000640 1 -- 172.21.15.7:0/4009295085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 msgr2=0x7fa94c107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa953000640 1 --2- 172.21.15.7:0/4009295085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c107d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009820 tx=0x7fa93c02a270 comp rx=0 tx=0).stop 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa953000640 1 -- 172.21.15.7:0/4009295085 shutdown_connections 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa953000640 1 --2- 172.21.15.7:0/4009295085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c107d50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:52.774 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa953000640 1 -- 172.21.15.7:0/4009295085 >> 172.21.15.7:0/4009295085 conn(0x7fa94c07af30 msgr2=0x7fa94c07b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa953000640 1 -- 172.21.15.7:0/4009295085 shutdown_connections 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.956+0000 7fa953000640 1 -- 172.21.15.7:0/4009295085 wait complete. 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.957+0000 7fa953000640 1 Processor -- start 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.957+0000 7fa953000640 1 -- start start 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.958+0000 7fa953000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.958+0000 7fa953000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c19bbc0 con 0x7fa94c107950 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.958+0000 7fa94be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.958+0000 7fa94be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50920/0 (socket says 172.21.15.7:50920) 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.958+0000 7fa94be00640 1 -- 172.21.15.7:0/3074220665 learned_addr learned my addr 172.21.15.7:0/3074220665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.958+0000 7fa94be00640 1 -- 172.21.15.7:0/3074220665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0094d0 con 0x7fa94c107950 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.959+0000 7fa94be00640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c19b680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0097f0 tx=0x7fa93c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.959+0000 7fa949600640 1 -- 172.21.15.7:0/3074220665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c032d90 con 0x7fa94c107950 2024-09-13T18:07:52.775 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.959+0000 7fa949600640 1 -- 172.21.15.7:0/3074220665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa93c03b8d0 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.959+0000 7fa949600640 1 -- 172.21.15.7:0/3074220665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c03a780 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.959+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c19bdc0 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.959+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c19c260 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.960+0000 7fa949600640 1 -- 172.21.15.7:0/3074220665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa93c039040 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.960+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c10bd80 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.961+0000 7fa949600640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fa930038670 0x7fa93003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.961+0000 7fa949600640 1 -- 172.21.15.7:0/3074220665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa93c06b790 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.961+0000 7fa943400640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fa930038670 0x7fa93003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.961+0000 7fa943400640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fa930038670 0x7fa93003ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa9340098c0 tx=0x7fa934006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:47.966+0000 7fa949600640 1 -- 172.21.15.7:0/3074220665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa93c03ba40 con 0x7fa94c107950 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:48.154+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa94c105bf0 con 0x7fa930038670 2024-09-13T18:07:52.776 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.115+0000 7fa949600640 1 -- 172.21.15.7:0/3074220665 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fa94c105bf0 con 0x7fa930038670 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.117+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fa930038670 msgr2=0x7fa93003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.117+0000 7fa953000640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fa930038670 0x7fa93003ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa9340098c0 tx=0x7fa934006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.117+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 msgr2=0x7fa94c19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.117+0000 7fa953000640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c19b680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0097f0 tx=0x7fa93c030db0 comp rx=0 tx=0).stop 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.117+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 shutdown_connections 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.117+0000 7fa953000640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fa930038670 0x7fa93003ab30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.117+0000 7fa953000640 1 --2- 172.21.15.7:0/3074220665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa94c107950 0x7fa94c19b680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.118+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 >> 172.21.15.7:0/3074220665 conn(0x7fa94c07af30 msgr2=0x7fa94c1054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.118+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 shutdown_connections 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:52.118+0000 7fa953000640 1 -- 172.21.15.7:0/3074220665 wait complete. 2024-09-13T18:07:52.777 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mon service... 2024-09-13T18:07:53.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:53 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:53.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:53 smithi007 ceph-mon[30588]: Added host smithi007 2024-09-13T18:07:53.415 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:53 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:07:55.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:54 smithi007 ceph-mon[30588]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:07:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:54 smithi007 ceph-mon[30588]: Saving service mon spec with placement count:5 2024-09-13T18:07:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:54 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:54 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:55.166 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T18:07:55.166 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.524+0000 7efe36000640 1 Processor -- start 2024-09-13T18:07:55.166 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.525+0000 7efe36000640 1 -- start start 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.525+0000 7efe36000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe30107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.525+0000 7efe36000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe301081c0 con 0x7efe301077f0 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.525+0000 7efe34c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe30107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.525+0000 7efe34c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe30107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50934/0 (socket says 172.21.15.7:50934) 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.525+0000 7efe34c00640 1 -- 172.21.15.7:0/2350530367 learned_addr learned my addr 172.21.15.7:0/2350530367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.526+0000 7efe34c00640 1 -- 172.21.15.7:0/2350530367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30108300 con 0x7efe301077f0 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.527+0000 7efe34c00640 1 --2- 172.21.15.7:0/2350530367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe30107bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efe20009820 tx=0x7efe2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96674f2fd764d9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.527+0000 7efe2fe00640 1 -- 172.21.15.7:0/2350530367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe2002ae70 con 0x7efe301077f0 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.527+0000 7efe2fe00640 1 -- 172.21.15.7:0/2350530367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe200328e0 con 0x7efe301077f0 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.527+0000 7efe2fe00640 1 -- 172.21.15.7:0/2350530367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe200308c0 con 0x7efe301077f0 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.527+0000 7efe36000640 1 -- 172.21.15.7:0/2350530367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 msgr2=0x7efe30107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.527+0000 7efe36000640 1 --2- 172.21.15.7:0/2350530367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe30107bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efe20009820 tx=0x7efe2002a270 comp rx=0 tx=0).stop 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.528+0000 7efe36000640 1 -- 172.21.15.7:0/2350530367 shutdown_connections 2024-09-13T18:07:55.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.528+0000 7efe36000640 1 --2- 172.21.15.7:0/2350530367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe30107bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.528+0000 7efe36000640 1 -- 172.21.15.7:0/2350530367 >> 172.21.15.7:0/2350530367 conn(0x7efe3007ad60 msgr2=0x7efe3007b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.528+0000 7efe36000640 1 -- 172.21.15.7:0/2350530367 shutdown_connections 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.528+0000 7efe36000640 1 -- 172.21.15.7:0/2350530367 wait complete. 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.529+0000 7efe36000640 1 Processor -- start 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.529+0000 7efe36000640 1 -- start start 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.529+0000 7efe36000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe3019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.529+0000 7efe36000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3019b9e0 con 0x7efe301077f0 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.529+0000 7efe34c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe3019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.529+0000 7efe34c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe3019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50950/0 (socket says 172.21.15.7:50950) 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.529+0000 7efe34c00640 1 -- 172.21.15.7:0/1615616107 learned_addr learned my addr 172.21.15.7:0/1615616107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.530+0000 7efe34c00640 1 -- 172.21.15.7:0/1615616107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200094d0 con 0x7efe301077f0 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.530+0000 7efe34c00640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe3019b4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe200305d0 tx=0x7efe20032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.530+0000 7efe2e000640 1 -- 172.21.15.7:0/1615616107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe20032c60 con 0x7efe301077f0 2024-09-13T18:07:55.168 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.530+0000 7efe2e000640 1 -- 172.21.15.7:0/1615616107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe20032dc0 con 0x7efe301077f0 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.530+0000 7efe2e000640 1 -- 172.21.15.7:0/1615616107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe2003a770 con 0x7efe301077f0 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.530+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3019bbe0 con 0x7efe301077f0 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.531+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3019c080 con 0x7efe301077f0 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.532+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3010bbc0 con 0x7efe301077f0 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.532+0000 7efe2e000640 1 -- 172.21.15.7:0/1615616107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7efe20039040 con 0x7efe301077f0 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.532+0000 7efe2e000640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7efe14038620 0x7efe1403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.532+0000 7efe2e000640 1 -- 172.21.15.7:0/1615616107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efe2006b7c0 con 0x7efe301077f0 2024-09-13T18:07:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.532+0000 7efe27e00640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7efe14038620 0x7efe1403aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.533+0000 7efe27e00640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7efe14038620 0x7efe1403aae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efe180098c0 tx=0x7efe18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.537+0000 7efe2e000640 1 -- 172.21.15.7:0/1615616107 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efe20031580 con 0x7efe301077f0 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.731+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7efe30105cc0 con 0x7efe14038620 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.736+0000 7efe2e000640 1 -- 172.21.15.7:0/1615616107 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7efe30105cc0 con 0x7efe14038620 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7efe14038620 msgr2=0x7efe1403aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7efe14038620 0x7efe1403aae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efe180098c0 tx=0x7efe18006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 msgr2=0x7efe3019b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe3019b4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe200305d0 tx=0x7efe20032670 comp rx=0 tx=0).stop 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 shutdown_connections 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7efe14038620 0x7efe1403aae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 --2- 172.21.15.7:0/1615616107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe301077f0 0x7efe3019b4a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 >> 172.21.15.7:0/1615616107 conn(0x7efe3007ad60 msgr2=0x7efe301055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 shutdown_connections 2024-09-13T18:07:55.170 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:53.739+0000 7efe36000640 1 -- 172.21.15.7:0/1615616107 wait complete. 2024-09-13T18:07:55.171 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mgr service... 2024-09-13T18:07:56.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:56 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:56.510 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:56 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:57.080 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T18:07:57.085 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.789+0000 7f98ca000640 1 Processor -- start 2024-09-13T18:07:57.085 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.789+0000 7f98ca000640 1 -- start start 2024-09-13T18:07:57.085 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.790+0000 7f98ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c41049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:57.085 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.790+0000 7f98ca000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4104fc0 con 0x7f98c41045f0 2024-09-13T18:07:57.085 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.790+0000 7f98c3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c41049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:57.085 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.790+0000 7f98c3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c41049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49208/0 (socket says 172.21.15.7:49208) 2024-09-13T18:07:57.085 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.790+0000 7f98c3400640 1 -- 172.21.15.7:0/2952229294 learned_addr learned my addr 172.21.15.7:0/2952229294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.791+0000 7f98c3400640 1 -- 172.21.15.7:0/2952229294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c41057f0 con 0x7f98c41045f0 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.792+0000 7f98c3400640 1 --2- 172.21.15.7:0/2952229294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c41049f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009820 tx=0x7f98b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd0a8543a7662bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.792+0000 7f98c2000640 1 -- 172.21.15.7:0/2952229294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98b402ae70 con 0x7f98c41045f0 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.792+0000 7f98c2000640 1 -- 172.21.15.7:0/2952229294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98b4032900 con 0x7f98c41045f0 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.792+0000 7f98c2000640 1 -- 172.21.15.7:0/2952229294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98b4030880 con 0x7f98c41045f0 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.793+0000 7f98ca000640 1 -- 172.21.15.7:0/2952229294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 msgr2=0x7f98c41049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.793+0000 7f98ca000640 1 --2- 172.21.15.7:0/2952229294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c41049f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009820 tx=0x7f98b402a270 comp rx=0 tx=0).stop 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.793+0000 7f98ca000640 1 -- 172.21.15.7:0/2952229294 shutdown_connections 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.793+0000 7f98ca000640 1 --2- 172.21.15.7:0/2952229294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c41049f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.793+0000 7f98ca000640 1 -- 172.21.15.7:0/2952229294 >> 172.21.15.7:0/2952229294 conn(0x7f98c40ffd80 msgr2=0x7f98c41021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.793+0000 7f98ca000640 1 -- 172.21.15.7:0/2952229294 shutdown_connections 2024-09-13T18:07:57.086 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.794+0000 7f98ca000640 1 -- 172.21.15.7:0/2952229294 wait complete. 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.795+0000 7f98ca000640 1 Processor -- start 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.795+0000 7f98ca000640 1 -- start start 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.796+0000 7f98ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c418f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.796+0000 7f98ca000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c418fcf0 con 0x7f98c41045f0 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.796+0000 7f98c3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c418f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.796+0000 7f98c3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c418f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49222/0 (socket says 172.21.15.7:49222) 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.796+0000 7f98c3400640 1 -- 172.21.15.7:0/2808932161 learned_addr learned my addr 172.21.15.7:0/2808932161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.796+0000 7f98c3400640 1 -- 172.21.15.7:0/2808932161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40094d0 con 0x7f98c41045f0 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.797+0000 7f98c3400640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c418f7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98b4030380 tx=0x7f98b4030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.797+0000 7f98bbe00640 1 -- 172.21.15.7:0/2808932161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98b4032db0 con 0x7f98c41045f0 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.797+0000 7f98bbe00640 1 -- 172.21.15.7:0/2808932161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98b403b8f0 con 0x7f98c41045f0 2024-09-13T18:07:57.087 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.797+0000 7f98bbe00640 1 -- 172.21.15.7:0/2808932161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98b403a760 con 0x7f98c41045f0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.797+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c418dee0 con 0x7f98c41045f0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.797+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c418e380 con 0x7f98c41045f0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.798+0000 7f98bbe00640 1 -- 172.21.15.7:0/2808932161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f98b4039040 con 0x7f98c41045f0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.799+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c41049f0 con 0x7f98c41045f0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.799+0000 7f98bbe00640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f98a8038620 0x7f98a803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.799+0000 7f98bbe00640 1 -- 172.21.15.7:0/2808932161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f98b406b790 con 0x7f98c41045f0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.800+0000 7f98c2a00640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f98a8038620 0x7f98a803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.800+0000 7f98c2a00640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f98a8038620 0x7f98a803aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98b00098c0 tx=0x7f98b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:55.804+0000 7f98bbe00640 1 -- 172.21.15.7:0/2808932161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f98b404b710 con 0x7f98c41045f0 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.058+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f98c41932f0 con 0x7f98a8038620 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.062+0000 7f98bbe00640 1 -- 172.21.15.7:0/2808932161 <== mgr.14118 v2:172.21.15.7:6800/3391098565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f98c41932f0 con 0x7f98a8038620 2024-09-13T18:07:57.088 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.064+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f98a8038620 msgr2=0x7f98a803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.064+0000 7f98ca000640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f98a8038620 0x7f98a803aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f98b00098c0 tx=0x7f98b0006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.064+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 msgr2=0x7f98c418f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.064+0000 7f98ca000640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c418f7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98b4030380 tx=0x7f98b4030de0 comp rx=0 tx=0).stop 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.065+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 shutdown_connections 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.065+0000 7f98ca000640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f98a8038620 0x7f98a803aae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.065+0000 7f98ca000640 1 --2- 172.21.15.7:0/2808932161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98c41045f0 0x7f98c418f7b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.065+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 >> 172.21.15.7:0/2808932161 conn(0x7f98c40ffd80 msgr2=0x7f98c4100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.065+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 shutdown_connections 2024-09-13T18:07:57.089 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:56.065+0000 7f98ca000640 1 -- 172.21.15.7:0/2808932161 wait complete. 2024-09-13T18:07:57.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:57 smithi007 ceph-mon[30588]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:07:57.332 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:57 smithi007 ceph-mon[30588]: Saving service mgr spec with placement count:2 2024-09-13T18:07:58.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.811+0000 7fd08dc00640 1 Processor -- start 2024-09-13T18:07:58.869 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.811+0000 7fd08dc00640 1 -- start start 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.811+0000 7fd08dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088108630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.811+0000 7fd08dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088079d90 con 0x7fd088106240 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.812+0000 7fd086a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088108630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.812+0000 7fd086a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088108630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49226/0 (socket says 172.21.15.7:49226) 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.812+0000 7fd086a00640 1 -- 172.21.15.7:0/3262117861 learned_addr learned my addr 172.21.15.7:0/3262117861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.812+0000 7fd086a00640 1 -- 172.21.15.7:0/3262117861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088079ed0 con 0x7fd088106240 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.814+0000 7fd086a00640 1 --2- 172.21.15.7:0/3262117861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088108630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd078009820 tx=0x7fd07802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74b4bee63a4cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.814+0000 7fd085600640 1 -- 172.21.15.7:0/3262117861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd07802ae70 con 0x7fd088106240 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.814+0000 7fd085600640 1 -- 172.21.15.7:0/3262117861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd078032900 con 0x7fd088106240 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.814+0000 7fd085600640 1 -- 172.21.15.7:0/3262117861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd078030880 con 0x7fd088106240 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.815+0000 7fd08dc00640 1 -- 172.21.15.7:0/3262117861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 msgr2=0x7fd088108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:58.870 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.815+0000 7fd08dc00640 1 --2- 172.21.15.7:0/3262117861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088108630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd078009820 tx=0x7fd07802a270 comp rx=0 tx=0).stop 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.815+0000 7fd08dc00640 1 -- 172.21.15.7:0/3262117861 shutdown_connections 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.815+0000 7fd08dc00640 1 --2- 172.21.15.7:0/3262117861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088108630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.815+0000 7fd08dc00640 1 -- 172.21.15.7:0/3262117861 >> 172.21.15.7:0/3262117861 conn(0x7fd0880ffd80 msgr2=0x7fd0881021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.815+0000 7fd08dc00640 1 -- 172.21.15.7:0/3262117861 shutdown_connections 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.815+0000 7fd08dc00640 1 -- 172.21.15.7:0/3262117861 wait complete. 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.816+0000 7fd08dc00640 1 Processor -- start 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.817+0000 7fd08dc00640 1 -- start start 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.817+0000 7fd08dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.817+0000 7fd08dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088199940 con 0x7fd088106240 2024-09-13T18:07:58.871 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.817+0000 7fd086a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.817+0000 7fd086a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49236/0 (socket says 172.21.15.7:49236) 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.817+0000 7fd086a00640 1 -- 172.21.15.7:0/2335214685 learned_addr learned my addr 172.21.15.7:0/2335214685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.818+0000 7fd086a00640 1 -- 172.21.15.7:0/2335214685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0780094d0 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.818+0000 7fd086a00640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088199400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd078030380 tx=0x7fd078030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.818+0000 7fd07f400640 1 -- 172.21.15.7:0/2335214685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd078032db0 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.818+0000 7fd07f400640 1 -- 172.21.15.7:0/2335214685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd07803b8f0 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.818+0000 7fd07f400640 1 -- 172.21.15.7:0/2335214685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd07803a760 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.818+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd088199b40 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.818+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd088199fe0 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.819+0000 7fd07f400640 1 -- 172.21.15.7:0/2335214685 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd078039040 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.820+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd088109900 con 0x7fd088106240 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.820+0000 7fd07f400640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fd06c0386c0 0x7fd06c03ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:58.872 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.820+0000 7fd07f400640 1 -- 172.21.15.7:0/2335214685 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd07806b8a0 con 0x7fd088106240 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.820+0000 7fd086000640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fd06c0386c0 0x7fd06c03ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.821+0000 7fd086000640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fd06c0386c0 0x7fd06c03ab80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098c0 tx=0x7fd074006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:57.825+0000 7fd07f400640 1 -- 172.21.15.7:0/2335214685 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd07804b710 con 0x7fd088106240 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.006+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fd088109b40 con 0x7fd088106240 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.010+0000 7fd07f400640 1 -- 172.21.15.7:0/2335214685 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd0780370d0 con 0x7fd088106240 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fd06c0386c0 msgr2=0x7fd06c03ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fd06c0386c0 0x7fd06c03ab80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098c0 tx=0x7fd074006db0 comp rx=0 tx=0).stop 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 msgr2=0x7fd088199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088199400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd078030380 tx=0x7fd078030de0 comp rx=0 tx=0).stop 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 shutdown_connections 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fd06c0386c0 0x7fd06c03ab80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 --2- 172.21.15.7:0/2335214685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd088106240 0x7fd088199400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:58.873 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 >> 172.21.15.7:0/2335214685 conn(0x7fd0880ffd80 msgr2=0x7fd088100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:58.874 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.013+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 shutdown_connections 2024-09-13T18:07:58.874 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:58.014+0000 7fd08dc00640 1 -- 172.21.15.7:0/2335214685 wait complete. 2024-09-13T18:07:59.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:58 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:07:59.150 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:07:58 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2335214685' entity='client.admin' 2024-09-13T18:08:00.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:00 smithi007 ceph-mon[30588]: from='mgr.14118 172.21.15.7:0/866067786' entity='mgr.x' 2024-09-13T18:08:00.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:00 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2278435013' entity='client.admin' 2024-09-13T18:08:01.198 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.397+0000 7f12bda00640 1 Processor -- start 2024-09-13T18:08:01.198 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.398+0000 7f12bda00640 1 -- start start 2024-09-13T18:08:01.198 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.398+0000 7f12bda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b807a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.398+0000 7f12bda00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b807a870 con 0x7f12b807be40 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.398+0000 7f12b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b807a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.399+0000 7f12b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b807a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49246/0 (socket says 172.21.15.7:49246) 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.399+0000 7f12b7e00640 1 -- 172.21.15.7:0/3914252087 learned_addr learned my addr 172.21.15.7:0/3914252087 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.399+0000 7f12b7e00640 1 -- 172.21.15.7:0/3914252087 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b807a9b0 con 0x7f12b807be40 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.400+0000 7f12b7e00640 1 --2- 172.21.15.7:0/3914252087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b807a2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009820 tx=0x7f12a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca7293cf26dda54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.400+0000 7f12b6a00640 1 -- 172.21.15.7:0/3914252087 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a802ae70 con 0x7f12b807be40 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.400+0000 7f12b6a00640 1 -- 172.21.15.7:0/3914252087 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12a8032900 con 0x7f12b807be40 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.400+0000 7f12b6a00640 1 -- 172.21.15.7:0/3914252087 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a8030880 con 0x7f12b807be40 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.401+0000 7f12bda00640 1 -- 172.21.15.7:0/3914252087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 msgr2=0x7f12b807a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.401+0000 7f12bda00640 1 --2- 172.21.15.7:0/3914252087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b807a2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009820 tx=0x7f12a802a270 comp rx=0 tx=0).stop 2024-09-13T18:08:01.199 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.401+0000 7f12bda00640 1 -- 172.21.15.7:0/3914252087 shutdown_connections 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.401+0000 7f12bda00640 1 --2- 172.21.15.7:0/3914252087 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b807a2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.401+0000 7f12bda00640 1 -- 172.21.15.7:0/3914252087 >> 172.21.15.7:0/3914252087 conn(0x7f12b8100cb0 msgr2=0x7f12b81030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.401+0000 7f12bda00640 1 -- 172.21.15.7:0/3914252087 shutdown_connections 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.401+0000 7f12bda00640 1 -- 172.21.15.7:0/3914252087 wait complete. 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.402+0000 7f12bda00640 1 Processor -- start 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.403+0000 7f12bda00640 1 -- start start 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.403+0000 7f12bda00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b819b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.403+0000 7f12bda00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b819b920 con 0x7f12b807be40 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.403+0000 7f12b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b819b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:01.200 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.403+0000 7f12b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b819b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49252/0 (socket says 172.21.15.7:49252) 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.403+0000 7f12b7e00640 1 -- 172.21.15.7:0/2278435013 learned_addr learned my addr 172.21.15.7:0/2278435013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.404+0000 7f12b7e00640 1 -- 172.21.15.7:0/2278435013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a80094d0 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.404+0000 7f12b7e00640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b819b3e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097f0 tx=0x7f12a8030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.404+0000 7f12b4c00640 1 -- 172.21.15.7:0/2278435013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a8032c80 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.404+0000 7f12b4c00640 1 -- 172.21.15.7:0/2278435013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12a8032de0 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.404+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b819bb20 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.404+0000 7f12b4c00640 1 -- 172.21.15.7:0/2278435013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a803a760 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.404+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b819bfc0 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.406+0000 7f12b4c00640 1 -- 172.21.15.7:0/2278435013 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f12a8039040 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.406+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b810b950 con 0x7f12b807be40 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.406+0000 7f12b4c00640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f129c038670 0x7f129c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:01.201 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.406+0000 7f12b4c00640 1 -- 172.21.15.7:0/2278435013 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f12a806ba20 con 0x7f12b807be40 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.406+0000 7f12b7400640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f129c038670 0x7f129c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.407+0000 7f12b7400640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f129c038670 0x7f129c03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098c0 tx=0x7f12a4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.411+0000 7f12b4c00640 1 -- 172.21.15.7:0/2278435013 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f12a804b710 con 0x7f12b807be40 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.606+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f12b810bb90 con 0x7f12b807be40 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.611+0000 7f12b4c00640 1 -- 172.21.15.7:0/2278435013 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f12a803f030 con 0x7f12b807be40 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f129c038670 msgr2=0x7f129c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f129c038670 0x7f129c03ab30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098c0 tx=0x7f12a4006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 msgr2=0x7f12b819b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b819b3e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097f0 tx=0x7f12a8030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 shutdown_connections 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f129c038670 0x7f129c03ab30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:01.202 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 --2- 172.21.15.7:0/2278435013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f12b807be40 0x7f12b819b3e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:01.203 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.614+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 >> 172.21.15.7:0/2278435013 conn(0x7f12b8100cb0 msgr2=0x7f12b81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:01.203 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.615+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 shutdown_connections 2024-09-13T18:08:01.203 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:07:59.615+0000 7f12bda00640 1 -- 172.21.15.7:0/2278435013 wait complete. 2024-09-13T18:08:01.203 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling the dashboard module... 2024-09-13T18:08:01.508 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:01 smithi007 ceph-mon[30588]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:02.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:02 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1402616998' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T18:08:02.686 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: ignoring --setuser ceph since I am not root 2024-09-13T18:08:02.687 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: ignoring --setgroup ceph since I am not root 2024-09-13T18:08:02.687 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:02.613+0000 7fbbbb038040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:08:02.687 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:02.684+0000 7fbbbb038040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:08:02.971 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:02.886+0000 7fbbbb038040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:08:02.972 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:02.969+0000 7fbbbb038040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:08:03.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.884+0000 7f296e400640 1 Processor -- start 2024-09-13T18:08:03.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.884+0000 7f296e400640 1 -- start start 2024-09-13T18:08:03.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.884+0000 7f296e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296807a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:03.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.884+0000 7f296e400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296807a7c0 con 0x7f296807be20 2024-09-13T18:08:03.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.884+0000 7f2967400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296807a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:03.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.884+0000 7f2967400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296807a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49264/0 (socket says 172.21.15.7:49264) 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.884+0000 7f2967400640 1 -- 172.21.15.7:0/1990063787 learned_addr learned my addr 172.21.15.7:0/1990063787 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.885+0000 7f2967400640 1 -- 172.21.15.7:0/1990063787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296807a900 con 0x7f296807be20 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.886+0000 7f2967400640 1 --2- 172.21.15.7:0/1990063787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296807a280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2958009820 tx=0x7f295802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cc114dd7dbbbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.886+0000 7f2966000640 1 -- 172.21.15.7:0/1990063787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f295802ae70 con 0x7f296807be20 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.886+0000 7f2966000640 1 -- 172.21.15.7:0/1990063787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2958032900 con 0x7f296807be20 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.886+0000 7f2966000640 1 -- 172.21.15.7:0/1990063787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2958030880 con 0x7f296807be20 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.887+0000 7f296e400640 1 -- 172.21.15.7:0/1990063787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 msgr2=0x7f296807a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.887+0000 7f296e400640 1 --2- 172.21.15.7:0/1990063787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296807a280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2958009820 tx=0x7f295802a270 comp rx=0 tx=0).stop 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.887+0000 7f296e400640 1 -- 172.21.15.7:0/1990063787 shutdown_connections 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.887+0000 7f296e400640 1 --2- 172.21.15.7:0/1990063787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296807a280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.887+0000 7f296e400640 1 -- 172.21.15.7:0/1990063787 >> 172.21.15.7:0/1990063787 conn(0x7f2968100fa0 msgr2=0x7f29681033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.887+0000 7f296e400640 1 -- 172.21.15.7:0/1990063787 shutdown_connections 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.887+0000 7f296e400640 1 -- 172.21.15.7:0/1990063787 wait complete. 2024-09-13T18:08:03.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.888+0000 7f296e400640 1 Processor -- start 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.888+0000 7f296e400640 1 -- start start 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.888+0000 7f296e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296819b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.888+0000 7f296e400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296819bb00 con 0x7f296807be20 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.889+0000 7f2967400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296819b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.889+0000 7f2967400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296819b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49280/0 (socket says 172.21.15.7:49280) 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.889+0000 7f2967400640 1 -- 172.21.15.7:0/1402616998 learned_addr learned my addr 172.21.15.7:0/1402616998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.889+0000 7f2967400640 1 -- 172.21.15.7:0/1402616998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580094d0 con 0x7f296807be20 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.889+0000 7f2967400640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296819b5c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29580097f0 tx=0x7f2958030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.890+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2958032c80 con 0x7f296807be20 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.890+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2958032de0 con 0x7f296807be20 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.890+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f295803a760 con 0x7f296807be20 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.890+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296819bd00 con 0x7f296807be20 2024-09-13T18:08:03.042 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.890+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296819c1a0 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.891+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f2958039040 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.891+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296810bb60 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.891+0000 7f295fe00640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f294c038670 0x7f294c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.891+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f295806b810 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.891+0000 7f2966a00640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f294c038670 0x7f294c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.892+0000 7f2966a00640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f294c038670 0x7f294c03ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29540098c0 tx=0x7f2954006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:01.896+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2958031790 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.120+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f296810bda0 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.365+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f295803a950 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.367+0000 7f295fe00640 1 -- 172.21.15.7:0/1402616998 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f2958049c40 con 0x7f296807be20 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f294c038670 msgr2=0x7f294c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f294c038670 0x7f294c03ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29540098c0 tx=0x7f2954006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:03.043 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 msgr2=0x7f296819b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:03.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296819b5c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29580097f0 tx=0x7f2958030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:03.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 shutdown_connections 2024-09-13T18:08:03.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f294c038670 0x7f294c03ab30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:03.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 --2- 172.21.15.7:0/1402616998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f296807be20 0x7f296819b5c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:03.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 >> 172.21.15.7:0/1402616998 conn(0x7f2968100fa0 msgr2=0x7f2968101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:03.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 shutdown_connections 2024-09-13T18:08:03.044 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:02.369+0000 7f296e400640 1 -- 172.21.15.7:0/1402616998 wait complete. 2024-09-13T18:08:03.290 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:03.159+0000 7fbbbb038040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:08:03.566 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:03.332+0000 7fbbbb038040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:08:03.566 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:03 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1402616998' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T18:08:03.566 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:03 smithi007 ceph-mon[30588]: mgrmap e9: x(active, since 22s) 2024-09-13T18:08:03.822 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:03.710+0000 7fbbbb038040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:08:03.822 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:03.784+0000 7fbbbb038040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:08:04.161 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:04 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:04.009+0000 7fbbbb038040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:08:04.445 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:04 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1927750494' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T18:08:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:08:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T18:08:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T18:08:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T18:08:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T18:08:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:08:04.461 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.563+0000 7fdd0da00640 1 Processor -- start 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.564+0000 7fdd0da00640 1 -- start start 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.564+0000 7fdd0da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.564+0000 7fdd0da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0807a8d0 con 0x7fdd0807bea0 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.564+0000 7fdd07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.564+0000 7fdd07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49316/0 (socket says 172.21.15.7:49316) 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.564+0000 7fdd07e00640 1 -- 172.21.15.7:0/1837267187 learned_addr learned my addr 172.21.15.7:0/1837267187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.565+0000 7fdd07e00640 1 -- 172.21.15.7:0/1837267187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0807aa10 con 0x7fdd0807bea0 2024-09-13T18:08:04.462 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.566+0000 7fdd07e00640 1 --2- 172.21.15.7:0/1837267187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0807a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009820 tx=0x7fdcf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d745426f2b07b009 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.566+0000 7fdd07400640 1 -- 172.21.15.7:0/1837267187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcf802ae70 con 0x7fdd0807bea0 2024-09-13T18:08:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.566+0000 7fdd07400640 1 -- 172.21.15.7:0/1837267187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcf8032900 con 0x7fdd0807bea0 2024-09-13T18:08:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.566+0000 7fdd07400640 1 -- 172.21.15.7:0/1837267187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcf8030880 con 0x7fdd0807bea0 2024-09-13T18:08:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.567+0000 7fdd0da00640 1 -- 172.21.15.7:0/1837267187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 msgr2=0x7fdd0807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.567+0000 7fdd0da00640 1 --2- 172.21.15.7:0/1837267187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0807a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009820 tx=0x7fdcf802a270 comp rx=0 tx=0).stop 2024-09-13T18:08:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.567+0000 7fdd0da00640 1 -- 172.21.15.7:0/1837267187 shutdown_connections 2024-09-13T18:08:04.463 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.567+0000 7fdd0da00640 1 --2- 172.21.15.7:0/1837267187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0807a300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.567+0000 7fdd0da00640 1 -- 172.21.15.7:0/1837267187 >> 172.21.15.7:0/1837267187 conn(0x7fdd08100d00 msgr2=0x7fdd08103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.567+0000 7fdd0da00640 1 -- 172.21.15.7:0/1837267187 shutdown_connections 2024-09-13T18:08:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.567+0000 7fdd0da00640 1 -- 172.21.15.7:0/1837267187 wait complete. 2024-09-13T18:08:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.568+0000 7fdd0da00640 1 Processor -- start 2024-09-13T18:08:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.568+0000 7fdd0da00640 1 -- start start 2024-09-13T18:08:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.568+0000 7fdd0da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:04.464 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.568+0000 7fdd0da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0819fd50 con 0x7fdd0807bea0 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.569+0000 7fdd07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.569+0000 7fdd07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49324/0 (socket says 172.21.15.7:49324) 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.569+0000 7fdd07e00640 1 -- 172.21.15.7:0/1927750494 learned_addr learned my addr 172.21.15.7:0/1927750494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.569+0000 7fdd07e00640 1 -- 172.21.15.7:0/1927750494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80094d0 con 0x7fdd0807bea0 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.569+0000 7fdd07e00640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0819f810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80097f0 tx=0x7fdcf8030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.570+0000 7fdd05600640 1 -- 172.21.15.7:0/1927750494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcf8032c80 con 0x7fdd0807bea0 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.570+0000 7fdd05600640 1 -- 172.21.15.7:0/1927750494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcf8032de0 con 0x7fdd0807bea0 2024-09-13T18:08:04.465 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.570+0000 7fdd05600640 1 -- 172.21.15.7:0/1927750494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcf803a690 con 0x7fdd0807bea0 2024-09-13T18:08:04.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.570+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0819ff50 con 0x7fdd0807bea0 2024-09-13T18:08:04.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.570+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd081a03f0 con 0x7fdd0807bea0 2024-09-13T18:08:04.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.571+0000 7fdd05600640 1 -- 172.21.15.7:0/1927750494 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fdcf8039040 con 0x7fdd0807bea0 2024-09-13T18:08:04.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.571+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd08198f80 con 0x7fdd0807bea0 2024-09-13T18:08:04.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.572+0000 7fdd05600640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 0x7fdcec03ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:04.466 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.572+0000 7fdd05600640 1 -- 172.21.15.7:0/1927750494 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdcf806b870 con 0x7fdd0807bea0 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.572+0000 7fdcffe00640 1 -- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 msgr2=0x7fdcec03ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3391098565 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.572+0000 7fdcffe00640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 0x7fdcec03ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.577+0000 7fdd05600640 1 -- 172.21.15.7:0/1927750494 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdcf8031580 con 0x7fdd0807bea0 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.773+0000 7fdcffe00640 1 -- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 msgr2=0x7fdcec03ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3391098565 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.773+0000 7fdcffe00640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 0x7fdcec03ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.804+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fdd081077f0 con 0x7fdd0807bea0 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.804+0000 7fdd05600640 1 -- 172.21.15.7:0/1927750494 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fdcf803f070 con 0x7fdd0807bea0 2024-09-13T18:08:04.467 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.806+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 msgr2=0x7fdcec03ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.806+0000 7fdd0da00640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 0x7fdcec03ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.806+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 msgr2=0x7fdd0819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.806+0000 7fdd0da00640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0819f810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80097f0 tx=0x7fdcf8030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.807+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 shutdown_connections 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.807+0000 7fdd0da00640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7fdcec0386c0 0x7fdcec03ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.807+0000 7fdd0da00640 1 --2- 172.21.15.7:0/1927750494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd0807bea0 0x7fdd0819f810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.807+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 >> 172.21.15.7:0/1927750494 conn(0x7fdd08100d00 msgr2=0x7fdd08103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.807+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 shutdown_connections 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:03.807+0000 7fdd0da00640 1 -- 172.21.15.7:0/1927750494 wait complete. 2024-09-13T18:08:04.468 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-13T18:08:04.469 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 9... 2024-09-13T18:08:05.290 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:05.144+0000 7fbbbb038040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:08:05.291 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:05.225+0000 7fbbbb038040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:08:06.403 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:06.167+0000 7fbbbb038040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:08:06.403 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:06.307+0000 7fbbbb038040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:08:06.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:06.475+0000 7fbbbb038040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:08:06.738 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:06.549+0000 7fbbbb038040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:08:07.040 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:06.744+0000 7fbbbb038040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:08:07.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:06.829+0000 7fbbbb038040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:08:07.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:06.902+0000 7fbbbb038040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:08:07.350 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:07.087+0000 7fbbbb038040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:08:07.350 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:07.166+0000 7fbbbb038040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:08:07.350 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:07.247+0000 7fbbbb038040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:08:07.350 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:07.347+0000 7fbbbb038040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:08:07.790 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:07.419+0000 7fbbbb038040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:08:07.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:07.491+0000 7fbbbb038040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:08:08.694 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:08.420+0000 7fbbbb038040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:08:08.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: Active manager daemon x restarted 2024-09-13T18:08:08.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: Activating manager daemon x 2024-09-13T18:08:08.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T18:08:08.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: mgrmap e10: x(active, starting, since 0.00380642s) 2024-09-13T18:08:08.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:08:08.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T18:08:08.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:08:08.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:08:08.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:08:08.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: Manager daemon x is now available 2024-09-13T18:08:08.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:09.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:08:09.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T18:08:09.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:09 smithi007 ceph-mon[30588]: mgrmap e11: x(active, since 1.00781s) 2024-09-13T18:08:10.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-mon[30588]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T18:08:10.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-mon[30588]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T18:08:10.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:10.687 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:08:10.687 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T18:08:10.687 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T18:08:10.687 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:08:10.688 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.989+0000 7f79a2c00640 1 Processor -- start 2024-09-13T18:08:10.688 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.989+0000 7f79a2c00640 1 -- start start 2024-09-13T18:08:10.688 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.989+0000 7f79a2c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:10.694 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.989+0000 7f79a2c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c07a890 con 0x7f799c07be60 2024-09-13T18:08:10.694 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.990+0000 7f799be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.990+0000 7f799be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42486/0 (socket says 172.21.15.7:42486) 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.990+0000 7f799be00640 1 -- 172.21.15.7:0/1334125999 learned_addr learned my addr 172.21.15.7:0/1334125999 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.990+0000 7f799be00640 1 -- 172.21.15.7:0/1334125999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c07a9d0 con 0x7f799c07be60 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.991+0000 7f799be00640 1 --2- 172.21.15.7:0/1334125999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c07a2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f798c009820 tx=0x7f798c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e42f6f243ba3cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.992+0000 7f799aa00640 1 -- 172.21.15.7:0/1334125999 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798c02ae70 con 0x7f799c07be60 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.992+0000 7f799aa00640 1 -- 172.21.15.7:0/1334125999 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f798c032900 con 0x7f799c07be60 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.992+0000 7f799aa00640 1 -- 172.21.15.7:0/1334125999 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798c030880 con 0x7f799c07be60 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.992+0000 7f79a2c00640 1 -- 172.21.15.7:0/1334125999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 msgr2=0x7f799c07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.992+0000 7f79a2c00640 1 --2- 172.21.15.7:0/1334125999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c07a2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f798c009820 tx=0x7f798c02a270 comp rx=0 tx=0).stop 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.993+0000 7f79a2c00640 1 -- 172.21.15.7:0/1334125999 shutdown_connections 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.993+0000 7f79a2c00640 1 --2- 172.21.15.7:0/1334125999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c07a2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:10.695 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.993+0000 7f79a2c00640 1 -- 172.21.15.7:0/1334125999 >> 172.21.15.7:0/1334125999 conn(0x7f799c100fa0 msgr2=0x7f799c1033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.993+0000 7f79a2c00640 1 -- 172.21.15.7:0/1334125999 shutdown_connections 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.993+0000 7f79a2c00640 1 -- 172.21.15.7:0/1334125999 wait complete. 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.994+0000 7f79a2c00640 1 Processor -- start 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.994+0000 7f79a2c00640 1 -- start start 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.994+0000 7f79a2c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c19b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.994+0000 7f79a2c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c19bb80 con 0x7f799c07be60 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.994+0000 7f799be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c19b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.994+0000 7f799be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c19b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42492/0 (socket says 172.21.15.7:42492) 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.994+0000 7f799be00640 1 -- 172.21.15.7:0/1743659946 learned_addr learned my addr 172.21.15.7:0/1743659946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.995+0000 7f799be00640 1 -- 172.21.15.7:0/1743659946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0094d0 con 0x7f799c07be60 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.995+0000 7f799be00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c19b640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f798c030410 tx=0x7f798c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:10.696 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.996+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798c032db0 con 0x7f799c07be60 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.996+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f798c03b8e0 con 0x7f799c07be60 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.996+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f798c03a6d0 con 0x7f799c07be60 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.996+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c19bd80 con 0x7f799c07be60 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.996+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c19c220 con 0x7f799c07be60 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.997+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f798c039070 con 0x7f799c07be60 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.997+0000 7f7998c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.997+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 --> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f798003b290 con 0x7f79800386c0 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.997+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f798c06b9c0 con 0x7f799c07be60 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.997+0000 7f799b400640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 msgr2=0x7f798003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3391098565 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:04.998+0000 7f799b400640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:05.199+0000 7f799b400640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 msgr2=0x7f798003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3391098565 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:05.199+0000 7f799b400640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:08:10.697 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:05.600+0000 7f799b400640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 msgr2=0x7f798003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3391098565 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:05.600+0000 7f799b400640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:06.401+0000 7f799b400640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 msgr2=0x7f798003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3391098565 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:06.401+0000 7f799b400640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:08.002+0000 7f799b400640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 msgr2=0x7f798003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/3391098565 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:08.002+0000 7f799b400640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:08.425+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f798c03bc50 con 0x7f799c07be60 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:08.425+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 msgr2=0x7f798003ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:08.425+0000 7f7998c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.427+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f798c06d2e0 con 0x7f799c07be60 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.427+0000 7f7998c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f798003bff0 0x7f798003e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.427+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f798003b290 con 0x7f798003bff0 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.428+0000 7f799b400640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f798003bff0 0x7f798003e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:10.698 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.429+0000 7f799b400640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f798003bff0 0x7f798003e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7988003980 tx=0x7f79880092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.430+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f798003b290 con 0x7f798003bff0 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.436+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f799c10bbe0 con 0x7f798003bff0 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.436+0000 7f7998c00640 1 -- 172.21.15.7:0/1743659946 <== mgr.14150 v2:172.21.15.7:6800/1436660417 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f799c10bbe0 con 0x7f798003bff0 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f798003bff0 msgr2=0x7f798003e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f798003bff0 0x7f798003e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7988003980 tx=0x7f79880092b0 comp rx=0 tx=0).stop 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 msgr2=0x7f799c19b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c19b640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f798c030410 tx=0x7f798c030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 shutdown_connections 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f798003bff0 0x7f798003e3e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:6800/3391098565,v1:172.21.15.7:6801/3391098565] conn(0x7f79800386c0 0x7f798003ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 --2- 172.21.15.7:0/1743659946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f799c07be60 0x7f799c19b640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 >> 172.21.15.7:0/1743659946 conn(0x7f799c100fa0 msgr2=0x7f799c101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 shutdown_connections 2024-09-13T18:08:10.699 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:09.437+0000 7f79a2c00640 1 -- 172.21.15.7:0/1743659946 wait complete. 2024-09-13T18:08:10.700 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 9 is available 2024-09-13T18:08:10.700 INFO:teuthology.orchestra.run.smithi007.stdout:Generating a dashboard self-signed certificate... 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:10.969+0000 7fbb19200640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:18:08:10] ENGINE Error in HTTPServer.serve 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: Traceback (most recent call last): 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self._connections.run(self.expiration_interval) 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self._run(expiration_interval) 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:08:11.203 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: s = self.context.wrap_socket( 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: return self.sslsocket_class._create( 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self.do_handshake() 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: self._sslobj.do_handshake() 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:08:11.204 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:08:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:08:12.277 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T18:08:12.278 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.199+0000 7f24a0400640 1 Processor -- start 2024-09-13T18:08:12.278 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.200+0000 7f24a0400640 1 -- start start 2024-09-13T18:08:12.278 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.200+0000 7f24a0400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f2498107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:12.278 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.200+0000 7f24a0400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2498108320 con 0x7f2498107950 2024-09-13T18:08:12.278 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.201+0000 7f249da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f2498107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:12.279 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.201+0000 7f249da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f2498107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42578/0 (socket says 172.21.15.7:42578) 2024-09-13T18:08:12.279 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.201+0000 7f249da00640 1 -- 172.21.15.7:0/3760845374 learned_addr learned my addr 172.21.15.7:0/3760845374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:12.279 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.201+0000 7f249da00640 1 -- 172.21.15.7:0/3760845374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498108b50 con 0x7f2498107950 2024-09-13T18:08:12.279 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.202+0000 7f249da00640 1 --2- 172.21.15.7:0/3760845374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f2498107d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f248c009820 tx=0x7f248c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c5fcbc31908f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:12.279 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.203+0000 7f2497e00640 1 -- 172.21.15.7:0/3760845374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f248c02ae70 con 0x7f2498107950 2024-09-13T18:08:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.203+0000 7f2497e00640 1 -- 172.21.15.7:0/3760845374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f248c032900 con 0x7f2498107950 2024-09-13T18:08:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.203+0000 7f2497e00640 1 -- 172.21.15.7:0/3760845374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f248c030880 con 0x7f2498107950 2024-09-13T18:08:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.203+0000 7f24a0400640 1 -- 172.21.15.7:0/3760845374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 msgr2=0x7f2498107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.203+0000 7f24a0400640 1 --2- 172.21.15.7:0/3760845374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f2498107d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f248c009820 tx=0x7f248c02a270 comp rx=0 tx=0).stop 2024-09-13T18:08:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.204+0000 7f24a0400640 1 -- 172.21.15.7:0/3760845374 shutdown_connections 2024-09-13T18:08:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.204+0000 7f24a0400640 1 --2- 172.21.15.7:0/3760845374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f2498107d50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:12.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.204+0000 7f24a0400640 1 -- 172.21.15.7:0/3760845374 >> 172.21.15.7:0/3760845374 conn(0x7f249807af30 msgr2=0x7f249807b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:12.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.204+0000 7f24a0400640 1 -- 172.21.15.7:0/3760845374 shutdown_connections 2024-09-13T18:08:12.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.204+0000 7f24a0400640 1 -- 172.21.15.7:0/3760845374 wait complete. 2024-09-13T18:08:12.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.205+0000 7f24a0400640 1 Processor -- start 2024-09-13T18:08:12.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.205+0000 7f24a0400640 1 -- start start 2024-09-13T18:08:12.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.205+0000 7f24a0400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f249819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:12.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.205+0000 7f24a0400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819bb60 con 0x7f2498107950 2024-09-13T18:08:12.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.205+0000 7f249da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f249819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:12.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.205+0000 7f249da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f249819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42582/0 (socket says 172.21.15.7:42582) 2024-09-13T18:08:12.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.205+0000 7f249da00640 1 -- 172.21.15.7:0/4227312395 learned_addr learned my addr 172.21.15.7:0/4227312395 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:12.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.206+0000 7f249da00640 1 -- 172.21.15.7:0/4227312395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c0094d0 con 0x7f2498107950 2024-09-13T18:08:12.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.206+0000 7f249da00640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f249819b620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f248c0097f0 tx=0x7f248c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:12.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.207+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f248c032c80 con 0x7f2498107950 2024-09-13T18:08:12.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.207+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f248c032de0 con 0x7f2498107950 2024-09-13T18:08:12.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.207+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f248c03a690 con 0x7f2498107950 2024-09-13T18:08:12.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.207+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249819bd60 con 0x7f2498107950 2024-09-13T18:08:12.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.207+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249819c200 con 0x7f2498107950 2024-09-13T18:08:12.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.208+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f248c039040 con 0x7f2498107950 2024-09-13T18:08:12.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.208+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249810bd80 con 0x7f2498107950 2024-09-13T18:08:12.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.208+0000 7f2496000640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f24800385a0 0x7f248003aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:12.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.208+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f248c06b6c0 con 0x7f2498107950 2024-09-13T18:08:12.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.209+0000 7f249d000640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f24800385a0 0x7f248003aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:12.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.209+0000 7f249d000640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f24800385a0 0x7f248003aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24840098c0 tx=0x7f2484006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:12.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.217+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f248c031580 con 0x7f2498107950 2024-09-13T18:08:12.286 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.253+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f248c03b430 con 0x7f2498107950 2024-09-13T18:08:12.286 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.425+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f249819eb40 con 0x7f24800385a0 2024-09-13T18:08:12.286 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.497+0000 7f2496000640 1 -- 172.21.15.7:0/4227312395 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f249819eb40 con 0x7f24800385a0 2024-09-13T18:08:12.286 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f24800385a0 msgr2=0x7f248003aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:12.286 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f24800385a0 0x7f248003aa60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24840098c0 tx=0x7f2484006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:12.286 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 msgr2=0x7f249819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f249819b620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f248c0097f0 tx=0x7f248c030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 shutdown_connections 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f24800385a0 0x7f248003aa60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 --2- 172.21.15.7:0/4227312395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2498107950 0x7f249819b620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 >> 172.21.15.7:0/4227312395 conn(0x7f249807af30 msgr2=0x7f2498105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 shutdown_connections 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:11.500+0000 7f24a0400640 1 -- 172.21.15.7:0/4227312395 wait complete. 2024-09-13T18:08:12.287 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial admin user... 2024-09-13T18:08:12.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: [13/Sep/2024:18:08:10] ENGINE Bus STARTING 2024-09-13T18:08:12.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: [13/Sep/2024:18:08:10] ENGINE Serving on https://172.21.15.7:7150 2024-09-13T18:08:12.520 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: [13/Sep/2024:18:08:10] ENGINE Error in HTTPServer.serve 2024-09-13T18:08:12.520 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-13T18:08:12.520 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:08:12.520 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:08:12.520 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-13T18:08:12.521 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: [13/Sep/2024:18:08:11] ENGINE Serving on http://172.21.15.7:8765 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: [13/Sep/2024:18:08:11] ENGINE Bus STARTED 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: mgrmap e12: x(active, since 2s) 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:12.522 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:12.523 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:12.523 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:14.508 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:14 smithi007 ceph-mon[30588]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:14.508 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:14.523 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$/RU3GnnTqinCTjzHFaBe8.nTZ8SraUEnbjznEMV1uzAlzppuRz/ky", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726250893, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T18:08:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.734+0000 7f6d5ea00640 1 Processor -- start 2024-09-13T18:08:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.734+0000 7f6d5ea00640 1 -- start start 2024-09-13T18:08:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.734+0000 7f6d5ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d58107c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.734+0000 7f6d5ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58108200 con 0x7f6d58107830 2024-09-13T18:08:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.734+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d58107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.734+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d58107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42584/0 (socket says 172.21.15.7:42584) 2024-09-13T18:08:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.735+0000 7f6d5d600640 1 -- 172.21.15.7:0/551549227 learned_addr learned my addr 172.21.15.7:0/551549227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.735+0000 7f6d5d600640 1 -- 172.21.15.7:0/551549227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58108970 con 0x7f6d58107830 2024-09-13T18:08:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.736+0000 7f6d5d600640 1 --2- 172.21.15.7:0/551549227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d58107c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009e80 tx=0x7f6d4c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660d3578422f8d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.736+0000 7f6d57e00640 1 -- 172.21.15.7:0/551549227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c031400 con 0x7f6d58107830 2024-09-13T18:08:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.736+0000 7f6d57e00640 1 -- 172.21.15.7:0/551549227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d4c02d050 con 0x7f6d58107830 2024-09-13T18:08:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.736+0000 7f6d57e00640 1 -- 172.21.15.7:0/551549227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c007960 con 0x7f6d58107830 2024-09-13T18:08:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.737+0000 7f6d5ea00640 1 -- 172.21.15.7:0/551549227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 msgr2=0x7f6d58107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.737+0000 7f6d5ea00640 1 --2- 172.21.15.7:0/551549227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d58107c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009e80 tx=0x7f6d4c02a7a0 comp rx=0 tx=0).stop 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.737+0000 7f6d5ea00640 1 -- 172.21.15.7:0/551549227 shutdown_connections 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.737+0000 7f6d5ea00640 1 --2- 172.21.15.7:0/551549227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d58107c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.737+0000 7f6d5ea00640 1 -- 172.21.15.7:0/551549227 >> 172.21.15.7:0/551549227 conn(0x7f6d5807ad10 msgr2=0x7f6d5807b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.737+0000 7f6d5ea00640 1 -- 172.21.15.7:0/551549227 shutdown_connections 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.737+0000 7f6d5ea00640 1 -- 172.21.15.7:0/551549227 wait complete. 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.738+0000 7f6d5ea00640 1 Processor -- start 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.739+0000 7f6d5ea00640 1 -- start start 2024-09-13T18:08:14.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.739+0000 7f6d5ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d5819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:14.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.739+0000 7f6d5ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5819ba00 con 0x7f6d58107830 2024-09-13T18:08:14.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.739+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d5819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:14.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.739+0000 7f6d5d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d5819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42600/0 (socket says 172.21.15.7:42600) 2024-09-13T18:08:14.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.739+0000 7f6d5d600640 1 -- 172.21.15.7:0/1804153817 learned_addr learned my addr 172.21.15.7:0/1804153817 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:14.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.740+0000 7f6d5d600640 1 -- 172.21.15.7:0/1804153817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c009b30 con 0x7f6d58107830 2024-09-13T18:08:14.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.740+0000 7f6d5d600640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d5819b4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c02acc0 tx=0x7f6d4c007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:14.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.740+0000 7f6d56000640 1 -- 172.21.15.7:0/1804153817 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c031e90 con 0x7f6d58107830 2024-09-13T18:08:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.740+0000 7f6d56000640 1 -- 172.21.15.7:0/1804153817 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d4c03d910 con 0x7f6d58107830 2024-09-13T18:08:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.740+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5819bc00 con 0x7f6d58107830 2024-09-13T18:08:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.740+0000 7f6d56000640 1 -- 172.21.15.7:0/1804153817 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c03b9a0 con 0x7f6d58107830 2024-09-13T18:08:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.740+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5819c100 con 0x7f6d58107830 2024-09-13T18:08:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.741+0000 7f6d56000640 1 -- 172.21.15.7:0/1804153817 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f6d4c03bc60 con 0x7f6d58107830 2024-09-13T18:08:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.741+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5810bba0 con 0x7f6d58107830 2024-09-13T18:08:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.742+0000 7f6d56000640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6d40038670 0x7f6d4003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:14.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.742+0000 7f6d56000640 1 -- 172.21.15.7:0/1804153817 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6d4c06c4c0 con 0x7f6d58107830 2024-09-13T18:08:14.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.742+0000 7f6d5cc00640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6d40038670 0x7f6d4003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:14.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.743+0000 7f6d5cc00640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6d40038670 0x7f6d4003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d440098c0 tx=0x7f6d44006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:14.529 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.747+0000 7f6d56000640 1 -- 172.21.15.7:0/1804153817 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6d4c03da80 con 0x7f6d58107830 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:12.965+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6d5810bde0 con 0x7f6d40038670 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.215+0000 7f6d56000640 1 -- 172.21.15.7:0/1804153817 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f6d5810bde0 con 0x7f6d40038670 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6d40038670 msgr2=0x7f6d4003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6d40038670 0x7f6d4003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d440098c0 tx=0x7f6d44006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 msgr2=0x7f6d5819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d5819b4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c02acc0 tx=0x7f6d4c007630 comp rx=0 tx=0).stop 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 shutdown_connections 2024-09-13T18:08:14.530 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6d40038670 0x7f6d4003ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:14.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 --2- 172.21.15.7:0/1804153817 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d58107830 0x7f6d5819b4c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:14.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 >> 172.21.15.7:0/1804153817 conn(0x7f6d5807ad10 msgr2=0x7f6d581054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:14.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 shutdown_connections 2024-09-13T18:08:14.531 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:13.218+0000 7f6d5ea00640 1 -- 172.21.15.7:0/1804153817 wait complete. 2024-09-13T18:08:14.531 INFO:teuthology.orchestra.run.smithi007.stdout:Fetching dashboard port number... 2024-09-13T18:08:15.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:15 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2295226419' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T18:08:16.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T18:08:16.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.009+0000 7f3b3d800640 1 Processor -- start 2024-09-13T18:08:16.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.010+0000 7f3b3d800640 1 -- start start 2024-09-13T18:08:16.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.010+0000 7f3b3d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b38105990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:16.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.010+0000 7f3b3d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38105f60 con 0x7f3b38105590 2024-09-13T18:08:16.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.010+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b38105990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:16.050 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.010+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b38105990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44788/0 (socket says 172.21.15.7:44788) 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.010+0000 7f3b37e00640 1 -- 172.21.15.7:0/900509590 learned_addr learned my addr 172.21.15.7:0/900509590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.011+0000 7f3b37e00640 1 -- 172.21.15.7:0/900509590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38106790 con 0x7f3b38105590 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.012+0000 7f3b37e00640 1 --2- 172.21.15.7:0/900509590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b38105990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009820 tx=0x7f3b2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971e3093a197ebb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.012+0000 7f3b37400640 1 -- 172.21.15.7:0/900509590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b2802ae70 con 0x7f3b38105590 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.012+0000 7f3b37400640 1 -- 172.21.15.7:0/900509590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b28032900 con 0x7f3b38105590 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.012+0000 7f3b37400640 1 -- 172.21.15.7:0/900509590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b28030880 con 0x7f3b38105590 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.012+0000 7f3b3d800640 1 -- 172.21.15.7:0/900509590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 msgr2=0x7f3b38105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.012+0000 7f3b3d800640 1 --2- 172.21.15.7:0/900509590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b38105990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009820 tx=0x7f3b2802a270 comp rx=0 tx=0).stop 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.013+0000 7f3b3d800640 1 -- 172.21.15.7:0/900509590 shutdown_connections 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.013+0000 7f3b3d800640 1 --2- 172.21.15.7:0/900509590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b38105990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.013+0000 7f3b3d800640 1 -- 172.21.15.7:0/900509590 >> 172.21.15.7:0/900509590 conn(0x7f3b38100d40 msgr2=0x7f3b38103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.013+0000 7f3b3d800640 1 -- 172.21.15.7:0/900509590 shutdown_connections 2024-09-13T18:08:16.051 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.013+0000 7f3b3d800640 1 -- 172.21.15.7:0/900509590 wait complete. 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.014+0000 7f3b3d800640 1 Processor -- start 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.014+0000 7f3b3d800640 1 -- start start 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.014+0000 7f3b3d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b3807bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.014+0000 7f3b3d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3807c070 con 0x7f3b38105590 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.014+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b3807bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.014+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b3807bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44800/0 (socket says 172.21.15.7:44800) 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.014+0000 7f3b37e00640 1 -- 172.21.15.7:0/2295226419 learned_addr learned my addr 172.21.15.7:0/2295226419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.015+0000 7f3b37e00640 1 -- 172.21.15.7:0/2295226419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280094d0 con 0x7f3b38105590 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.015+0000 7f3b37e00640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b3807bb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b280097f0 tx=0x7f3b28030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.015+0000 7f3b35600640 1 -- 172.21.15.7:0/2295226419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b28032c80 con 0x7f3b38105590 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.015+0000 7f3b35600640 1 -- 172.21.15.7:0/2295226419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b28032de0 con 0x7f3b38105590 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.015+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3807a260 con 0x7f3b38105590 2024-09-13T18:08:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.015+0000 7f3b35600640 1 -- 172.21.15.7:0/2295226419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b2803a690 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.015+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3807a700 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.016+0000 7f3b35600640 1 -- 172.21.15.7:0/2295226419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f3b28039040 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.017+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b381099c0 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.017+0000 7f3b35600640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b1c0386c0 0x7f3b1c03ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.017+0000 7f3b35600640 1 -- 172.21.15.7:0/2295226419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3b2806b900 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.017+0000 7f3b2fe00640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b1c0386c0 0x7f3b1c03ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.018+0000 7f3b2fe00640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b1c0386c0 0x7f3b1c03ab80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b200098c0 tx=0x7f3b20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.022+0000 7f3b35600640 1 -- 172.21.15.7:0/2295226419 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3b280313a0 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.203+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f3b3807aa60 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.204+0000 7f3b35600640 1 -- 172.21.15.7:0/2295226419 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f3b2803f0b0 con 0x7f3b38105590 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b1c0386c0 msgr2=0x7f3b1c03ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b1c0386c0 0x7f3b1c03ab80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b200098c0 tx=0x7f3b20006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 msgr2=0x7f3b3807bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b3807bb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b280097f0 tx=0x7f3b28030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 shutdown_connections 2024-09-13T18:08:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b1c0386c0 0x7f3b1c03ab80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 --2- 172.21.15.7:0/2295226419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b38105590 0x7f3b3807bb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.206+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 >> 172.21.15.7:0/2295226419 conn(0x7f3b38100d40 msgr2=0x7f3b38101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.207+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 shutdown_connections 2024-09-13T18:08:16.054 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:15.207+0000 7f3b3d800640 1 -- 172.21.15.7:0/2295226419 wait complete. 2024-09-13T18:08:16.066 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:08:16.066 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-13T18:08:16.079 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:08:16.079 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-13T18:08:16.079 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-13T18:08:16.079 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T18:08:16.081 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph Dashboard is now available at: 2024-09-13T18:08:16.082 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:16.082 INFO:teuthology.orchestra.run.smithi007.stdout: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-09-13T18:08:16.082 INFO:teuthology.orchestra.run.smithi007.stdout: User: admin 2024-09-13T18:08:16.082 INFO:teuthology.orchestra.run.smithi007.stdout: Password: 6ppquyn2ou 2024-09-13T18:08:16.082 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:16.082 INFO:teuthology.orchestra.run.smithi007.stdout:Saving cluster configuration to /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config directory 2024-09-13T18:08:16.083 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling autotune for osd_memory_target 2024-09-13T18:08:16.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:16 smithi007 ceph-mon[30588]: mgrmap e13: x(active, since 6s) 2024-09-13T18:08:17.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.719+0000 7f4499e00640 1 Processor -- start 2024-09-13T18:08:17.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.719+0000 7f4499e00640 1 -- start start 2024-09-13T18:08:17.524 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.720+0000 7f4499e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f4494107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.720+0000 7f4499e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494108320 con 0x7f4494107950 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.720+0000 7f4492a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f4494107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.720+0000 7f4492a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f4494107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44802/0 (socket says 172.21.15.7:44802) 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.720+0000 7f4492a00640 1 -- 172.21.15.7:0/815139872 learned_addr learned my addr 172.21.15.7:0/815139872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.720+0000 7f4492a00640 1 -- 172.21.15.7:0/815139872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494108b50 con 0x7f4494107950 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.721+0000 7f4492a00640 1 --2- 172.21.15.7:0/815139872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f4494107d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4484009820 tx=0x7f448402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9898014c649cedae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4492000640 1 -- 172.21.15.7:0/815139872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f448402ae70 con 0x7f4494107950 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4492000640 1 -- 172.21.15.7:0/815139872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4484032900 con 0x7f4494107950 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4492000640 1 -- 172.21.15.7:0/815139872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4484030880 con 0x7f4494107950 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4499e00640 1 -- 172.21.15.7:0/815139872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 msgr2=0x7f4494107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4499e00640 1 --2- 172.21.15.7:0/815139872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f4494107d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4484009820 tx=0x7f448402a270 comp rx=0 tx=0).stop 2024-09-13T18:08:17.525 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4499e00640 1 -- 172.21.15.7:0/815139872 shutdown_connections 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4499e00640 1 --2- 172.21.15.7:0/815139872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f4494107d50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4499e00640 1 -- 172.21.15.7:0/815139872 >> 172.21.15.7:0/815139872 conn(0x7f449407af30 msgr2=0x7f449407b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.722+0000 7f4499e00640 1 -- 172.21.15.7:0/815139872 shutdown_connections 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.723+0000 7f4499e00640 1 -- 172.21.15.7:0/815139872 wait complete. 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.723+0000 7f4499e00640 1 Processor -- start 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.724+0000 7f4499e00640 1 -- start start 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.724+0000 7f4499e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f449419b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.724+0000 7f4499e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449419bb60 con 0x7f4494107950 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.724+0000 7f4492a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f449419b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.724+0000 7f4492a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f449419b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44818/0 (socket says 172.21.15.7:44818) 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.724+0000 7f4492a00640 1 -- 172.21.15.7:0/4112525889 learned_addr learned my addr 172.21.15.7:0/4112525889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.724+0000 7f4492a00640 1 -- 172.21.15.7:0/4112525889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840094d0 con 0x7f4494107950 2024-09-13T18:08:17.526 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.725+0000 7f4492a00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f449419b620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f44840097f0 tx=0x7f4484030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.725+0000 7f4498a00640 1 -- 172.21.15.7:0/4112525889 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4484032c80 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.725+0000 7f4498a00640 1 -- 172.21.15.7:0/4112525889 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4484032de0 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.725+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449419bd60 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.725+0000 7f4498a00640 1 -- 172.21.15.7:0/4112525889 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f448403a690 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.725+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449419c200 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.726+0000 7f4498a00640 1 -- 172.21.15.7:0/4112525889 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f4484039040 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.726+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449410bd80 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.727+0000 7f4498a00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4478038760 0x7f447803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.727+0000 7f4498a00640 1 -- 172.21.15.7:0/4112525889 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f448406b9f0 con 0x7f4494107950 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.727+0000 7f448be00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4478038760 0x7f447803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.728+0000 7f448be00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4478038760 0x7f447803ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098c0 tx=0x7f447c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:17.527 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.731+0000 7f4498a00640 1 -- 172.21.15.7:0/4112525889 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f44840313a0 con 0x7f4494107950 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.915+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f449410bfc0 con 0x7f4494107950 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.915+0000 7f4498a00640 1 -- 172.21.15.7:0/4112525889 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f448403f070 con 0x7f4494107950 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.917+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4478038760 msgr2=0x7f447803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.917+0000 7f4499e00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4478038760 0x7f447803ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098c0 tx=0x7f447c006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 msgr2=0x7f449419b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f449419b620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f44840097f0 tx=0x7f4484030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 shutdown_connections 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4478038760 0x7f447803ac20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 --2- 172.21.15.7:0/4112525889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4494107950 0x7f449419b620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 >> 172.21.15.7:0/4112525889 conn(0x7f449407af30 msgr2=0x7f4494105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 shutdown_connections 2024-09-13T18:08:17.528 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:16.918+0000 7f4499e00640 1 -- 172.21.15.7:0/4112525889 wait complete. 2024-09-13T18:08:19.021 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.972+0000 7f71efc00640 1 Processor -- start 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.972+0000 7f71efc00640 1 -- start start 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.972+0000 7f71efc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e8107d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.972+0000 7f71efc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e8108320 con 0x7f71e8107950 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.972+0000 7f71ed200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e8107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.972+0000 7f71ed200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e8107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44824/0 (socket says 172.21.15.7:44824) 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.972+0000 7f71ed200640 1 -- 172.21.15.7:0/3099274430 learned_addr learned my addr 172.21.15.7:0/3099274430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.973+0000 7f71ed200640 1 -- 172.21.15.7:0/3099274430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8108b50 con 0x7f71e8107950 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.974+0000 7f71ed200640 1 --2- 172.21.15.7:0/3099274430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e8107d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009820 tx=0x7f71dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b309a083adf3d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.974+0000 7f71e7400640 1 -- 172.21.15.7:0/3099274430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71dc02ae70 con 0x7f71e8107950 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.974+0000 7f71e7400640 1 -- 172.21.15.7:0/3099274430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71dc032900 con 0x7f71e8107950 2024-09-13T18:08:19.022 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.974+0000 7f71e7400640 1 -- 172.21.15.7:0/3099274430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71dc030880 con 0x7f71e8107950 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.975+0000 7f71efc00640 1 -- 172.21.15.7:0/3099274430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 msgr2=0x7f71e8107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.975+0000 7f71efc00640 1 --2- 172.21.15.7:0/3099274430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e8107d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009820 tx=0x7f71dc02a270 comp rx=0 tx=0).stop 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.975+0000 7f71efc00640 1 -- 172.21.15.7:0/3099274430 shutdown_connections 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.975+0000 7f71efc00640 1 --2- 172.21.15.7:0/3099274430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e8107d50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.975+0000 7f71efc00640 1 -- 172.21.15.7:0/3099274430 >> 172.21.15.7:0/3099274430 conn(0x7f71e807af50 msgr2=0x7f71e807b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.975+0000 7f71efc00640 1 -- 172.21.15.7:0/3099274430 shutdown_connections 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.975+0000 7f71efc00640 1 -- 172.21.15.7:0/3099274430 wait complete. 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.976+0000 7f71efc00640 1 Processor -- start 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.976+0000 7f71efc00640 1 -- start start 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.976+0000 7f71efc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.976+0000 7f71efc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e819bb60 con 0x7f71e8107950 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.976+0000 7f71ed200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.976+0000 7f71ed200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44828/0 (socket says 172.21.15.7:44828) 2024-09-13T18:08:19.023 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.976+0000 7f71ed200640 1 -- 172.21.15.7:0/2561595437 learned_addr learned my addr 172.21.15.7:0/2561595437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.977+0000 7f71ed200640 1 -- 172.21.15.7:0/2561595437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0094d0 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.977+0000 7f71ed200640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e819b620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0097f0 tx=0x7f71dc030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.977+0000 7f71e5600640 1 -- 172.21.15.7:0/2561595437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71dc032c80 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.977+0000 7f71e5600640 1 -- 172.21.15.7:0/2561595437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71dc032de0 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.977+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e819bd60 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.977+0000 7f71e5600640 1 -- 172.21.15.7:0/2561595437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71dc03a690 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.978+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e819c200 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.978+0000 7f71e5600640 1 -- 172.21.15.7:0/2561595437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f71dc039040 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.979+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e810bd80 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.979+0000 7f71e5600640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f71d0038710 0x7f71d003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.979+0000 7f71e5600640 1 -- 172.21.15.7:0/2561595437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f71dc06ba40 con 0x7f71e8107950 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.979+0000 7f71e7e00640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f71d0038710 0x7f71d003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.024 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.980+0000 7f71e7e00640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f71d0038710 0x7f71d003abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f71d40098c0 tx=0x7f71d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:17.984+0000 7f71e5600640 1 -- 172.21.15.7:0/2561595437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f71dc0313a0 con 0x7f71e8107950 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.253+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f71e810bfc0 con 0x7f71e8107950 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.256+0000 7f71e5600640 1 -- 172.21.15.7:0/2561595437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f71dc03f070 con 0x7f71e8107950 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f71d0038710 msgr2=0x7f71d003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f71d0038710 0x7f71d003abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f71d40098c0 tx=0x7f71d4006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 msgr2=0x7f71e819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e819b620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0097f0 tx=0x7f71dc030d70 comp rx=0 tx=0).stop 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 shutdown_connections 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f71d0038710 0x7f71d003abd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 --2- 172.21.15.7:0/2561595437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e8107950 0x7f71e819b620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.258+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 >> 172.21.15.7:0/2561595437 conn(0x7f71e807af50 msgr2=0x7f71e8105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.025 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.259+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 shutdown_connections 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-13T18:08:18.259+0000 7f71efc00640 1 -- 172.21.15.7:0/2561595437 wait complete. 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: ceph telemetry on 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout:For more information see: 2024-09-13T18:08:19.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.027 INFO:teuthology.orchestra.run.smithi007.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T18:08:19.027 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:19.027 INFO:teuthology.orchestra.run.smithi007.stdout:Bootstrap complete. 2024-09-13T18:08:19.073 INFO:tasks.cephadm:Fetching config... 2024-09-13T18:08:19.073 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:08:19.073 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T18:08:19.112 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T18:08:19.112 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:08:19.112 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T18:08:19.188 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T18:08:19.188 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:08:19.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T18:08:19.266 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:19 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2561595437' entity='client.admin' 2024-09-13T18:08:19.287 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T18:08:19.287 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:08:19.287 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T18:08:19.363 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T18:08:19.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2kzuTLXTri3cf7lk8Ycd/S/36SEJjfqS2m7hFmEIGHNWbJV8Ozni1IPoSYXjwDY7xlFeP6pnPOZ5fQsf6CpL9gzzmLUwPhlGR+AjcLvIPrsbT1ytjXS5BX4vDED3UJG88vbD/wWgCWxIwUHec+eBER1CoUom4nql7B2b0ZjtLKDIKL+Y7D1TMYiAcyTtolsl4KRFYSwbUG8HwlXuV33ZdAQM/y+o///qcJETQ/EiRZIyU5tAkNdseLsB3eTPSlx2qx8GBYNlM+3ZWOP8US/JZw1LK7uBYFG9sX7sa6v5EcHj5Ld59YVKlJsgjko42ypuv1mYG0APY9oXl9LRgtZDlA+rm2AAUKINM04JiE2goFZ3/MQwW7Nd9HbiHOt6/l2OmSU1dw6/KQOy4qCErtlvrmC+N/Jc6VCzNQxJvCNbz32pelpKycLtpSbL5YC9yXxmz+R6+xQnyGweZ8spMQix0WgecRqVikgoWv2ZFi/6q4we0hFitLqLqNUqJmqpCQYk= ceph-d9377e86-71fa-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T18:08:19.481 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2kzuTLXTri3cf7lk8Ycd/S/36SEJjfqS2m7hFmEIGHNWbJV8Ozni1IPoSYXjwDY7xlFeP6pnPOZ5fQsf6CpL9gzzmLUwPhlGR+AjcLvIPrsbT1ytjXS5BX4vDED3UJG88vbD/wWgCWxIwUHec+eBER1CoUom4nql7B2b0ZjtLKDIKL+Y7D1TMYiAcyTtolsl4KRFYSwbUG8HwlXuV33ZdAQM/y+o///qcJETQ/EiRZIyU5tAkNdseLsB3eTPSlx2qx8GBYNlM+3ZWOP8US/JZw1LK7uBYFG9sX7sa6v5EcHj5Ld59YVKlJsgjko42ypuv1mYG0APY9oXl9LRgtZDlA+rm2AAUKINM04JiE2goFZ3/MQwW7Nd9HbiHOt6/l2OmSU1dw6/KQOy4qCErtlvrmC+N/Jc6VCzNQxJvCNbz32pelpKycLtpSbL5YC9yXxmz+R6+xQnyGweZ8spMQix0WgecRqVikgoWv2ZFi/6q4we0hFitLqLqNUqJmqpCQYk= ceph-d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:08:19.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2kzuTLXTri3cf7lk8Ycd/S/36SEJjfqS2m7hFmEIGHNWbJV8Ozni1IPoSYXjwDY7xlFeP6pnPOZ5fQsf6CpL9gzzmLUwPhlGR+AjcLvIPrsbT1ytjXS5BX4vDED3UJG88vbD/wWgCWxIwUHec+eBER1CoUom4nql7B2b0ZjtLKDIKL+Y7D1TMYiAcyTtolsl4KRFYSwbUG8HwlXuV33ZdAQM/y+o///qcJETQ/EiRZIyU5tAkNdseLsB3eTPSlx2qx8GBYNlM+3ZWOP8US/JZw1LK7uBYFG9sX7sa6v5EcHj5Ld59YVKlJsgjko42ypuv1mYG0APY9oXl9LRgtZDlA+rm2AAUKINM04JiE2goFZ3/MQwW7Nd9HbiHOt6/l2OmSU1dw6/KQOy4qCErtlvrmC+N/Jc6VCzNQxJvCNbz32pelpKycLtpSbL5YC9yXxmz+R6+xQnyGweZ8spMQix0WgecRqVikgoWv2ZFi/6q4we0hFitLqLqNUqJmqpCQYk= ceph-d9377e86-71fa-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T18:08:19.547 INFO:teuthology.orchestra.run.smithi067.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2kzuTLXTri3cf7lk8Ycd/S/36SEJjfqS2m7hFmEIGHNWbJV8Ozni1IPoSYXjwDY7xlFeP6pnPOZ5fQsf6CpL9gzzmLUwPhlGR+AjcLvIPrsbT1ytjXS5BX4vDED3UJG88vbD/wWgCWxIwUHec+eBER1CoUom4nql7B2b0ZjtLKDIKL+Y7D1TMYiAcyTtolsl4KRFYSwbUG8HwlXuV33ZdAQM/y+o///qcJETQ/EiRZIyU5tAkNdseLsB3eTPSlx2qx8GBYNlM+3ZWOP8US/JZw1LK7uBYFG9sX7sa6v5EcHj5Ld59YVKlJsgjko42ypuv1mYG0APY9oXl9LRgtZDlA+rm2AAUKINM04JiE2goFZ3/MQwW7Nd9HbiHOt6/l2OmSU1dw6/KQOy4qCErtlvrmC+N/Jc6VCzNQxJvCNbz32pelpKycLtpSbL5YC9yXxmz+R6+xQnyGweZ8spMQix0WgecRqVikgoWv2ZFi/6q4we0hFitLqLqNUqJmqpCQYk= ceph-d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:08:19.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2kzuTLXTri3cf7lk8Ycd/S/36SEJjfqS2m7hFmEIGHNWbJV8Ozni1IPoSYXjwDY7xlFeP6pnPOZ5fQsf6CpL9gzzmLUwPhlGR+AjcLvIPrsbT1ytjXS5BX4vDED3UJG88vbD/wWgCWxIwUHec+eBER1CoUom4nql7B2b0ZjtLKDIKL+Y7D1TMYiAcyTtolsl4KRFYSwbUG8HwlXuV33ZdAQM/y+o///qcJETQ/EiRZIyU5tAkNdseLsB3eTPSlx2qx8GBYNlM+3ZWOP8US/JZw1LK7uBYFG9sX7sa6v5EcHj5Ld59YVKlJsgjko42ypuv1mYG0APY9oXl9LRgtZDlA+rm2AAUKINM04JiE2goFZ3/MQwW7Nd9HbiHOt6/l2OmSU1dw6/KQOy4qCErtlvrmC+N/Jc6VCzNQxJvCNbz32pelpKycLtpSbL5YC9yXxmz+R6+xQnyGweZ8spMQix0WgecRqVikgoWv2ZFi/6q4we0hFitLqLqNUqJmqpCQYk= ceph-d9377e86-71fa-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T18:08:19.612 INFO:teuthology.orchestra.run.smithi116.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2kzuTLXTri3cf7lk8Ycd/S/36SEJjfqS2m7hFmEIGHNWbJV8Ozni1IPoSYXjwDY7xlFeP6pnPOZ5fQsf6CpL9gzzmLUwPhlGR+AjcLvIPrsbT1ytjXS5BX4vDED3UJG88vbD/wWgCWxIwUHec+eBER1CoUom4nql7B2b0ZjtLKDIKL+Y7D1TMYiAcyTtolsl4KRFYSwbUG8HwlXuV33ZdAQM/y+o///qcJETQ/EiRZIyU5tAkNdseLsB3eTPSlx2qx8GBYNlM+3ZWOP8US/JZw1LK7uBYFG9sX7sa6v5EcHj5Ld59YVKlJsgjko42ypuv1mYG0APY9oXl9LRgtZDlA+rm2AAUKINM04JiE2goFZ3/MQwW7Nd9HbiHOt6/l2OmSU1dw6/KQOy4qCErtlvrmC+N/Jc6VCzNQxJvCNbz32pelpKycLtpSbL5YC9yXxmz+R6+xQnyGweZ8spMQix0WgecRqVikgoWv2ZFi/6q4we0hFitLqLqNUqJmqpCQYk= ceph-d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:08:19.625 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T18:08:19.936 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:08:22.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:22.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:22.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:08:22.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:22.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:22.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.520+0000 7fa6e1e00640 1 -- 172.21.15.7:0/3008616484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 msgr2=0x7fa6dc101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.520+0000 7fa6e1e00640 1 --2- 172.21.15.7:0/3008616484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc101df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009880 tx=0x7fa6cc02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.520+0000 7fa6e1e00640 1 -- 172.21.15.7:0/3008616484 shutdown_connections 2024-09-13T18:08:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.520+0000 7fa6e1e00640 1 --2- 172.21.15.7:0/3008616484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc101df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.520+0000 7fa6e1e00640 1 -- 172.21.15.7:0/3008616484 >> 172.21.15.7:0/3008616484 conn(0x7fa6dc0fd1a0 msgr2=0x7fa6dc0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.520+0000 7fa6e1e00640 1 -- 172.21.15.7:0/3008616484 shutdown_connections 2024-09-13T18:08:22.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.520+0000 7fa6e1e00640 1 -- 172.21.15.7:0/3008616484 wait complete. 2024-09-13T18:08:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.521+0000 7fa6e1e00640 1 Processor -- start 2024-09-13T18:08:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.521+0000 7fa6e1e00640 1 -- start start 2024-09-13T18:08:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.522+0000 7fa6e1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.522+0000 7fa6e1e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc197340 con 0x7fa6dc1019f0 2024-09-13T18:08:22.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.522+0000 7fa6daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.522+0000 7fa6daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44858/0 (socket says 172.21.15.7:44858) 2024-09-13T18:08:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.522+0000 7fa6daa00640 1 -- 172.21.15.7:0/2761065789 learned_addr learned my addr 172.21.15.7:0/2761065789 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.522+0000 7fa6daa00640 1 -- 172.21.15.7:0/2761065789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009560 con 0x7fa6dc1019f0 2024-09-13T18:08:22.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.523+0000 7fa6daa00640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc196e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc004e60 tx=0x7fa6cc004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.523+0000 7fa6e0a00640 1 -- 172.21.15.7:0/2761065789 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6cc005520 con 0x7fa6dc1019f0 2024-09-13T18:08:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.523+0000 7fa6e0a00640 1 -- 172.21.15.7:0/2761065789 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6cc003ab0 con 0x7fa6dc1019f0 2024-09-13T18:08:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.523+0000 7fa6e0a00640 1 -- 172.21.15.7:0/2761065789 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6cc03c980 con 0x7fa6dc1019f0 2024-09-13T18:08:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.523+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc197540 con 0x7fa6dc1019f0 2024-09-13T18:08:22.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.523+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc1979e0 con 0x7fa6dc1019f0 2024-09-13T18:08:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.525+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc101df0 con 0x7fa6dc1019f0 2024-09-13T18:08:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.525+0000 7fa6e0a00640 1 -- 172.21.15.7:0/2761065789 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7fa6cc003c20 con 0x7fa6dc1019f0 2024-09-13T18:08:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.525+0000 7fa6e0a00640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa6c0038760 0x7fa6c003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:22.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.525+0000 7fa6e0a00640 1 -- 172.21.15.7:0/2761065789 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa6cc06c5b0 con 0x7fa6dc1019f0 2024-09-13T18:08:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.526+0000 7fa6da000640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa6c0038760 0x7fa6c003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:22.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.526+0000 7fa6da000640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa6c0038760 0x7fa6c003ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80098c0 tx=0x7fa6c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:22.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.530+0000 7fa6e0a00640 1 -- 172.21.15.7:0/2761065789 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa6cc04d350 con 0x7fa6dc1019f0 2024-09-13T18:08:22.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.712+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fa6dc190710 con 0x7fa6dc1019f0 2024-09-13T18:08:22.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.716+0000 7fa6e0a00640 1 -- 172.21.15.7:0/2761065789 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa6cc035070 con 0x7fa6dc1019f0 2024-09-13T18:08:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa6c0038760 msgr2=0x7fa6c003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:22.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa6c0038760 0x7fa6c003ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80098c0 tx=0x7fa6c8006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 msgr2=0x7fa6dc196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc196e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc004e60 tx=0x7fa6cc004f30 comp rx=0 tx=0).stop 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 shutdown_connections 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa6c0038760 0x7fa6c003ac20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 --2- 172.21.15.7:0/2761065789 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc1019f0 0x7fa6dc196e00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 >> 172.21.15.7:0/2761065789 conn(0x7fa6dc0fd1a0 msgr2=0x7fa6dc0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 shutdown_connections 2024-09-13T18:08:22.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:22.719+0000 7fa6e1e00640 1 -- 172.21.15.7:0/2761065789 wait complete. 2024-09-13T18:08:23.467 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T18:08:23.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T18:08:24.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:23 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2761065789' entity='client.admin' 2024-09-13T18:08:24.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:24.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:24.184 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:08:25.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.939+0000 7f0533e00640 1 -- 172.21.15.7:0/2571197108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 msgr2=0x7f052c0ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:25.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.939+0000 7f0533e00640 1 --2- 172.21.15.7:0/2571197108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c0ffc00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0520009880 tx=0x7f052002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:25.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.939+0000 7f0533e00640 1 -- 172.21.15.7:0/2571197108 shutdown_connections 2024-09-13T18:08:25.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.939+0000 7f0533e00640 1 --2- 172.21.15.7:0/2571197108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c0ffc00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:25.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.939+0000 7f0533e00640 1 -- 172.21.15.7:0/2571197108 >> 172.21.15.7:0/2571197108 conn(0x7f052c0fafd0 msgr2=0x7f052c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:25.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.939+0000 7f0533e00640 1 -- 172.21.15.7:0/2571197108 shutdown_connections 2024-09-13T18:08:25.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.940+0000 7f0533e00640 1 -- 172.21.15.7:0/2571197108 wait complete. 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.940+0000 7f0533e00640 1 Processor -- start 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.941+0000 7f0533e00640 1 -- start start 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.941+0000 7f0533e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.941+0000 7f0533e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c197370 con 0x7f052c0ff800 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.941+0000 7f0531400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.941+0000 7f0531400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43490/0 (socket says 172.21.15.7:43490) 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.941+0000 7f0531400640 1 -- 172.21.15.7:0/2517785142 learned_addr learned my addr 172.21.15.7:0/2517785142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:25.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.942+0000 7f0531400640 1 -- 172.21.15.7:0/2517785142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009560 con 0x7f052c0ff800 2024-09-13T18:08:25.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.942+0000 7f0531400640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c196e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0520005ab0 tx=0x7f0520005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:25.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.942+0000 7f052a000640 1 -- 172.21.15.7:0/2517785142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0520005580 con 0x7f052c0ff800 2024-09-13T18:08:25.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.942+0000 7f052a000640 1 -- 172.21.15.7:0/2517785142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0520003ab0 con 0x7f052c0ff800 2024-09-13T18:08:25.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.942+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c197570 con 0x7f052c0ff800 2024-09-13T18:08:25.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.942+0000 7f052a000640 1 -- 172.21.15.7:0/2517785142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052003ca30 con 0x7f052c0ff800 2024-09-13T18:08:25.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.942+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c197a10 con 0x7f052c0ff800 2024-09-13T18:08:25.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.943+0000 7f052a000640 1 -- 172.21.15.7:0/2517785142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f0520003c20 con 0x7f052c0ff800 2024-09-13T18:08:25.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.943+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c0ffc00 con 0x7f052c0ff800 2024-09-13T18:08:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.944+0000 7f052a000640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0514038760 0x7f051403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.944+0000 7f052a000640 1 -- 172.21.15.7:0/2517785142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f052006c520 con 0x7f052c0ff800 2024-09-13T18:08:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.944+0000 7f0530a00640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0514038760 0x7f051403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:25.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.945+0000 7f0530a00640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0514038760 0x7f051403ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f05180098c0 tx=0x7f0518006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:25.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:25.949+0000 7f052a000640 1 -- 172.21.15.7:0/2517785142 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f052003abf0 con 0x7f052c0ff800 2024-09-13T18:08:26.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.132+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f052c060980 con 0x7f0514038760 2024-09-13T18:08:26.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.136+0000 7f052a000640 1 -- 172.21.15.7:0/2517785142 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f052c060980 con 0x7f0514038760 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0514038760 msgr2=0x7f051403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0514038760 0x7f051403ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f05180098c0 tx=0x7f0518006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 msgr2=0x7f052c196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c196e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0520005ab0 tx=0x7f0520005160 comp rx=0 tx=0).stop 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 shutdown_connections 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0514038760 0x7f051403ac20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 --2- 172.21.15.7:0/2517785142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f052c0ff800 0x7f052c196e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.138+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 >> 172.21.15.7:0/2517785142 conn(0x7f052c0fafd0 msgr2=0x7f052c0fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:26.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.139+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 shutdown_connections 2024-09-13T18:08:26.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:26.139+0000 7f0533e00640 1 -- 172.21.15.7:0/2517785142 wait complete. 2024-09-13T18:08:26.976 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi067 2024-09-13T18:08:26.976 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:08:26.976 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/etc/ceph/ceph.conf 2024-09-13T18:08:26.996 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:08:26.996 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:27.054 INFO:tasks.cephadm:Adding host smithi067 to orchestrator... 2024-09-13T18:08:27.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch host add smithi067 2024-09-13T18:08:27.396 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:08:27.537 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:27 smithi007 ceph-mon[30588]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:27.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:27.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:27.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:27.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:08:27.538 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:27 smithi007 ceph-mon[30588]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T18:08:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:28 smithi007 ceph-mon[30588]: Updating smithi007:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:08:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:28 smithi007 ceph-mon[30588]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.179+0000 7f5c21e00640 1 -- 172.21.15.7:0/1786919727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 msgr2=0x7f5c1c107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.179+0000 7f5c21e00640 1 --2- 172.21.15.7:0/1786919727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c107d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009880 tx=0x7f5c0c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.179+0000 7f5c21e00640 1 -- 172.21.15.7:0/1786919727 shutdown_connections 2024-09-13T18:08:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.179+0000 7f5c21e00640 1 --2- 172.21.15.7:0/1786919727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c107d50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.179+0000 7f5c21e00640 1 -- 172.21.15.7:0/1786919727 >> 172.21.15.7:0/1786919727 conn(0x7f5c1c0fd630 msgr2=0x7f5c1c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:29.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.179+0000 7f5c21e00640 1 -- 172.21.15.7:0/1786919727 shutdown_connections 2024-09-13T18:08:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.179+0000 7f5c21e00640 1 -- 172.21.15.7:0/1786919727 wait complete. 2024-09-13T18:08:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.180+0000 7f5c21e00640 1 Processor -- start 2024-09-13T18:08:29.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.180+0000 7f5c21e00640 1 -- start start 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.180+0000 7f5c21e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.180+0000 7f5c21e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c197720 con 0x7f5c1c107970 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.181+0000 7f5c1aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.181+0000 7f5c1aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43508/0 (socket says 172.21.15.7:43508) 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.181+0000 7f5c1aa00640 1 -- 172.21.15.7:0/1647675220 learned_addr learned my addr 172.21.15.7:0/1647675220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.181+0000 7f5c1aa00640 1 -- 172.21.15.7:0/1647675220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c009560 con 0x7f5c1c107970 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.181+0000 7f5c1aa00640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c1971e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009230 tx=0x7f5c0c004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.182+0000 7f5c20a00640 1 -- 172.21.15.7:0/1647675220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c0054d0 con 0x7f5c1c107970 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.182+0000 7f5c20a00640 1 -- 172.21.15.7:0/1647675220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c0c003ab0 con 0x7f5c1c107970 2024-09-13T18:08:29.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.182+0000 7f5c20a00640 1 -- 172.21.15.7:0/1647675220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c03c940 con 0x7f5c1c107970 2024-09-13T18:08:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.182+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c197980 con 0x7f5c1c107970 2024-09-13T18:08:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.182+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c197e00 con 0x7f5c1c107970 2024-09-13T18:08:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.183+0000 7f5c20a00640 1 -- 172.21.15.7:0/1647675220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f5c0c003c20 con 0x7f5c1c107970 2024-09-13T18:08:29.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.183+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c1030b0 con 0x7f5c1c107970 2024-09-13T18:08:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.183+0000 7f5c20a00640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5c000387b0 0x7f5c0003ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.183+0000 7f5c20a00640 1 -- 172.21.15.7:0/1647675220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5c0c06c410 con 0x7f5c1c107970 2024-09-13T18:08:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.184+0000 7f5c12000640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5c000387b0 0x7f5c0003ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:29.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.184+0000 7f5c12000640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5c000387b0 0x7f5c0003ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c040098c0 tx=0x7f5c04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:29.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.189+0000 7f5c20a00640 1 -- 172.21.15.7:0/1647675220 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5c0c04d530 con 0x7f5c1c107970 2024-09-13T18:08:29.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:29 smithi007 ceph-mon[30588]: Updating smithi007:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:08:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:29 smithi007 ceph-mon[30588]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:29.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:29.376+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi067", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c1c10bce0 con 0x7f5c000387b0 2024-09-13T18:08:30.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:30 smithi007 ceph-mon[30588]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi067", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:31.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:31 smithi007 ceph-mon[30588]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:32.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:32 smithi007 ceph-mon[30588]: Deploying cephadm binary to smithi067 2024-09-13T18:08:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.639+0000 7f5c20a00640 1 -- 172.21.15.7:0/1647675220 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f5c1c10bce0 con 0x7f5c000387b0 2024-09-13T18:08:32.643 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi067' with addr '172.21.15.67' 2024-09-13T18:08:32.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5c000387b0 msgr2=0x7f5c0003ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5c000387b0 0x7f5c0003ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c040098c0 tx=0x7f5c04006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 msgr2=0x7f5c1c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c1971e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009230 tx=0x7f5c0c004e50 comp rx=0 tx=0).stop 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 shutdown_connections 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5c000387b0 0x7f5c0003ac70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 --2- 172.21.15.7:0/1647675220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c1c107970 0x7f5c1c1971e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 >> 172.21.15.7:0/1647675220 conn(0x7f5c1c0fd630 msgr2=0x7f5c1c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 shutdown_connections 2024-09-13T18:08:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:32.642+0000 7f5c21e00640 1 -- 172.21.15.7:0/1647675220 wait complete. 2024-09-13T18:08:33.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:33 smithi007 ceph-mon[30588]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:33.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:33.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:33.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:33.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:33.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T18:08:33.627 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:08:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:34 smithi007 ceph-mon[30588]: Added host smithi067 2024-09-13T18:08:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:35.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.314+0000 7f1f55a00640 1 -- 172.21.15.7:0/2988727718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 msgr2=0x7f1f50105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.314+0000 7f1f55a00640 1 --2- 172.21.15.7:0/2988727718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50105a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009880 tx=0x7f1f4002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.314+0000 7f1f55a00640 1 -- 172.21.15.7:0/2988727718 shutdown_connections 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.314+0000 7f1f55a00640 1 --2- 172.21.15.7:0/2988727718 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50105a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.314+0000 7f1f55a00640 1 -- 172.21.15.7:0/2988727718 >> 172.21.15.7:0/2988727718 conn(0x7f1f500fb250 msgr2=0x7f1f500fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.314+0000 7f1f55a00640 1 -- 172.21.15.7:0/2988727718 shutdown_connections 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.314+0000 7f1f55a00640 1 -- 172.21.15.7:0/2988727718 wait complete. 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.315+0000 7f1f55a00640 1 Processor -- start 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.315+0000 7f1f55a00640 1 -- start start 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.315+0000 7f1f55a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.315+0000 7f1f55a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f50197490 con 0x7f1f50105660 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.315+0000 7f1f4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.315+0000 7f1f4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50020/0 (socket says 172.21.15.7:50020) 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.315+0000 7f1f4fe00640 1 -- 172.21.15.7:0/4248874944 learned_addr learned my addr 172.21.15.7:0/4248874944 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.316+0000 7f1f4fe00640 1 -- 172.21.15.7:0/4248874944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40009560 con 0x7f1f50105660 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.316+0000 7f1f4fe00640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50196f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009230 tx=0x7f1f40004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.316+0000 7f1f4cc00640 1 -- 172.21.15.7:0/4248874944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f400054d0 con 0x7f1f50105660 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.316+0000 7f1f4cc00640 1 -- 172.21.15.7:0/4248874944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f40003ab0 con 0x7f1f50105660 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.316+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f501976f0 con 0x7f1f50105660 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.316+0000 7f1f4cc00640 1 -- 172.21.15.7:0/4248874944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f4003c940 con 0x7f1f50105660 2024-09-13T18:08:35.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.317+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f50197bf0 con 0x7f1f50105660 2024-09-13T18:08:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.318+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f50100d10 con 0x7f1f50105660 2024-09-13T18:08:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.318+0000 7f1f4cc00640 1 -- 172.21.15.7:0/4248874944 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f1f40003c20 con 0x7f1f50105660 2024-09-13T18:08:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.318+0000 7f1f4cc00640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1f34038710 0x7f1f3403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.318+0000 7f1f4cc00640 1 -- 172.21.15.7:0/4248874944 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1f4006c280 con 0x7f1f50105660 2024-09-13T18:08:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.319+0000 7f1f4f400640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1f34038710 0x7f1f3403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.319+0000 7f1f4f400640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1f34038710 0x7f1f3403abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0098c0 tx=0x7f1f3c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.323+0000 7f1f4cc00640 1 -- 172.21.15.7:0/4248874944 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1f4003ad30 con 0x7f1f50105660 2024-09-13T18:08:35.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:35 smithi007 ceph-mon[30588]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:35.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.509+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f50197bf0 con 0x7f1f34038710 2024-09-13T18:08:35.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.510+0000 7f1f4cc00640 1 -- 172.21.15.7:0/4248874944 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+158 (secure 0 0 0) 0x7f1f50197bf0 con 0x7f1f34038710 2024-09-13T18:08:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:35.514 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}] 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.512+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1f34038710 msgr2=0x7f1f3403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.512+0000 7f1f55a00640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1f34038710 0x7f1f3403abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0098c0 tx=0x7f1f3c006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.512+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 msgr2=0x7f1f50196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.512+0000 7f1f55a00640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50196f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009230 tx=0x7f1f40004e50 comp rx=0 tx=0).stop 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.512+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 shutdown_connections 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.512+0000 7f1f55a00640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1f34038710 0x7f1f3403abd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.512+0000 7f1f55a00640 1 --2- 172.21.15.7:0/4248874944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f50105660 0x7f1f50196f50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:35.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.513+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 >> 172.21.15.7:0/4248874944 conn(0x7f1f500fb250 msgr2=0x7f1f500fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:35.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.513+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 shutdown_connections 2024-09-13T18:08:35.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:35.513+0000 7f1f55a00640 1 -- 172.21.15.7:0/4248874944 wait complete. 2024-09-13T18:08:36.141 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi116 2024-09-13T18:08:36.141 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:08:36.141 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.conf 2024-09-13T18:08:36.163 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:08:36.163 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:36.221 INFO:tasks.cephadm:Adding host smithi116 to orchestrator... 2024-09-13T18:08:36.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch host add smithi116 2024-09-13T18:08:36.531 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:08:37.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:08:37.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:37.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:37.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:37.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:37.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:37.725 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:08:37.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:37.726 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:08:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.347+0000 7fa832400640 1 -- 172.21.15.7:0/1568931736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 msgr2=0x7fa82c107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.347+0000 7fa832400640 1 --2- 172.21.15.7:0/1568931736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c107d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009880 tx=0x7fa81c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:38.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.347+0000 7fa832400640 1 -- 172.21.15.7:0/1568931736 shutdown_connections 2024-09-13T18:08:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.347+0000 7fa832400640 1 --2- 172.21.15.7:0/1568931736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c107d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.347+0000 7fa832400640 1 -- 172.21.15.7:0/1568931736 >> 172.21.15.7:0/1568931736 conn(0x7fa82c0fd690 msgr2=0x7fa82c0ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.347+0000 7fa832400640 1 -- 172.21.15.7:0/1568931736 shutdown_connections 2024-09-13T18:08:38.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.347+0000 7fa832400640 1 -- 172.21.15.7:0/1568931736 wait complete. 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.348+0000 7fa832400640 1 Processor -- start 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.348+0000 7fa832400640 1 -- start start 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.348+0000 7fa832400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.348+0000 7fa832400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c1976b0 con 0x7fa82c107970 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.349+0000 7fa82b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.349+0000 7fa82b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50030/0 (socket says 172.21.15.7:50030) 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.349+0000 7fa82b400640 1 -- 172.21.15.7:0/652444835 learned_addr learned my addr 172.21.15.7:0/652444835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.349+0000 7fa82b400640 1 -- 172.21.15.7:0/652444835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009560 con 0x7fa82c107970 2024-09-13T18:08:38.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.349+0000 7fa82b400640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c197170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009230 tx=0x7fa81c004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.349+0000 7fa828c00640 1 -- 172.21.15.7:0/652444835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa81c0054d0 con 0x7fa82c107970 2024-09-13T18:08:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.350+0000 7fa828c00640 1 -- 172.21.15.7:0/652444835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa81c003ab0 con 0x7fa82c107970 2024-09-13T18:08:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.350+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c197910 con 0x7fa82c107970 2024-09-13T18:08:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.350+0000 7fa828c00640 1 -- 172.21.15.7:0/652444835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa81c03c940 con 0x7fa82c107970 2024-09-13T18:08:38.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.350+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c197d90 con 0x7fa82c107970 2024-09-13T18:08:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.351+0000 7fa828c00640 1 -- 172.21.15.7:0/652444835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7fa81c0035f0 con 0x7fa82c107970 2024-09-13T18:08:38.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.351+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c1030b0 con 0x7fa82c107970 2024-09-13T18:08:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.351+0000 7fa828c00640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa810038760 0x7fa81003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.351+0000 7fa828c00640 1 -- 172.21.15.7:0/652444835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa81c06c3d0 con 0x7fa82c107970 2024-09-13T18:08:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.351+0000 7fa823e00640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa810038760 0x7fa81003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:38.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.352+0000 7fa823e00640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa810038760 0x7fa81003ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8140098c0 tx=0x7fa814006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:38.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.356+0000 7fa828c00640 1 -- 172.21.15.7:0/652444835 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa81c04d530 con 0x7fa82c107970 2024-09-13T18:08:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:38.544+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}) v1 -- 0x7fa82c10bd50 con 0x7fa810038760 2024-09-13T18:08:38.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:38 smithi007 ceph-mon[30588]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-13T18:08:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:38 smithi007 ceph-mon[30588]: Updating smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:08:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:38 smithi007 ceph-mon[30588]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:38 smithi007 ceph-mon[30588]: Updating smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:08:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:39.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:39 smithi007 ceph-mon[30588]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:40.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:40 smithi007 ceph-mon[30588]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:41.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:41 smithi007 ceph-mon[30588]: Deploying cephadm binary to smithi116 2024-09-13T18:08:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:41 smithi007 ceph-mon[30588]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:41.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.839+0000 7fa828c00640 1 -- 172.21.15.7:0/652444835 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa82c10bd50 con 0x7fa810038760 2024-09-13T18:08:41.842 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi116' with addr '172.21.15.116' 2024-09-13T18:08:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa810038760 msgr2=0x7fa81003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa810038760 0x7fa81003ac20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa8140098c0 tx=0x7fa814006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:41.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 msgr2=0x7fa82c197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c197170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009230 tx=0x7fa81c004e50 comp rx=0 tx=0).stop 2024-09-13T18:08:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 shutdown_connections 2024-09-13T18:08:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa810038760 0x7fa81003ac20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 --2- 172.21.15.7:0/652444835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa82c107970 0x7fa82c197170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 >> 172.21.15.7:0/652444835 conn(0x7fa82c0fd690 msgr2=0x7fa82c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 shutdown_connections 2024-09-13T18:08:41.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:41.842+0000 7fa832400640 1 -- 172.21.15.7:0/652444835 wait complete. 2024-09-13T18:08:42.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T18:08:42.812 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:08:43.112 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:43.113 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:42 smithi007 ceph-mon[30588]: Added host smithi116 2024-09-13T18:08:43.113 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:43.113 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:43.113 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:43.113 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:42 smithi007 ceph-mon[30588]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:44.272 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:44 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.508+0000 7f6452a00640 1 -- 172.21.15.7:0/1773077905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 msgr2=0x7f644c074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.508+0000 7f6452a00640 1 --2- 172.21.15.7:0/1773077905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c074dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f643c009880 tx=0x7f643c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.508+0000 7f6452a00640 1 -- 172.21.15.7:0/1773077905 shutdown_connections 2024-09-13T18:08:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.508+0000 7f6452a00640 1 --2- 172.21.15.7:0/1773077905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c074dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.508+0000 7f6452a00640 1 -- 172.21.15.7:0/1773077905 >> 172.21.15.7:0/1773077905 conn(0x7f644c0fd630 msgr2=0x7f644c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.508+0000 7f6452a00640 1 -- 172.21.15.7:0/1773077905 shutdown_connections 2024-09-13T18:08:44.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.508+0000 7f6452a00640 1 -- 172.21.15.7:0/1773077905 wait complete. 2024-09-13T18:08:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.510+0000 7f6452a00640 1 Processor -- start 2024-09-13T18:08:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.510+0000 7f6452a00640 1 -- start start 2024-09-13T18:08:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.510+0000 7f6452a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:44.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.510+0000 7f6452a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c19bb90 con 0x7f644c0749e0 2024-09-13T18:08:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.510+0000 7f644be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.511+0000 7f644be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57824/0 (socket says 172.21.15.7:57824) 2024-09-13T18:08:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.511+0000 7f644be00640 1 -- 172.21.15.7:0/2798100365 learned_addr learned my addr 172.21.15.7:0/2798100365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:44.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.511+0000 7f644be00640 1 -- 172.21.15.7:0/2798100365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c009560 con 0x7f644c0749e0 2024-09-13T18:08:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.511+0000 7f644be00640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c19b650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f643c009230 tx=0x7f643c004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.511+0000 7f6448c00640 1 -- 172.21.15.7:0/2798100365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f643c0054d0 con 0x7f644c0749e0 2024-09-13T18:08:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.512+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c19bd90 con 0x7f644c0749e0 2024-09-13T18:08:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.511+0000 7f6448c00640 1 -- 172.21.15.7:0/2798100365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f643c003ab0 con 0x7f644c0749e0 2024-09-13T18:08:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.512+0000 7f6448c00640 1 -- 172.21.15.7:0/2798100365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f643c03c940 con 0x7f644c0749e0 2024-09-13T18:08:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.512+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c19c1b0 con 0x7f644c0749e0 2024-09-13T18:08:44.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.513+0000 7f6448c00640 1 -- 172.21.15.7:0/2798100365 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f643c003c20 con 0x7f644c0749e0 2024-09-13T18:08:44.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.513+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c076120 con 0x7f644c0749e0 2024-09-13T18:08:44.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.513+0000 7f6448c00640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6430038760 0x7f643003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:44.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.513+0000 7f6448c00640 1 -- 172.21.15.7:0/2798100365 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f643c06c430 con 0x7f644c0749e0 2024-09-13T18:08:44.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.513+0000 7f644b400640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6430038760 0x7f643003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:44.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.514+0000 7f644b400640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6430038760 0x7f643003ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f64380098c0 tx=0x7f6438006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:44.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.518+0000 7f6448c00640 1 -- 172.21.15.7:0/2798100365 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f643c04d530 con 0x7f644c0749e0 2024-09-13T18:08:44.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.705+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f644c110140 con 0x7f6430038760 2024-09-13T18:08:44.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.706+0000 7f6448c00640 1 -- 172.21.15.7:0/2798100365 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f644c110140 con 0x7f6430038760 2024-09-13T18:08:44.708 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:08:44.709 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}] 2024-09-13T18:08:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6430038760 msgr2=0x7f643003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6430038760 0x7f643003ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f64380098c0 tx=0x7f6438006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 msgr2=0x7f644c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c19b650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f643c009230 tx=0x7f643c004e50 comp rx=0 tx=0).stop 2024-09-13T18:08:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 shutdown_connections 2024-09-13T18:08:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6430038760 0x7f643003ac20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 --2- 172.21.15.7:0/2798100365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f644c0749e0 0x7f644c19b650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 >> 172.21.15.7:0/2798100365 conn(0x7f644c0fd630 msgr2=0x7f644c10c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 shutdown_connections 2024-09-13T18:08:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:44.709+0000 7f6452a00640 1 -- 172.21.15.7:0/2798100365 wait complete. 2024-09-13T18:08:45.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:45 smithi007 ceph-mon[30588]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:45.342 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T18:08:45.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T18:08:45.652 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:08:46.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:08:46.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:46.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:46.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:46.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:46.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:08:46.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:46.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: Updating smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: Updating smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:47.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.467+0000 7f4c27200640 1 -- 172.21.15.7:0/1773576101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 msgr2=0x7f4c280fe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.467+0000 7f4c27200640 1 --2- 172.21.15.7:0/1773576101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c280fe770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009880 tx=0x7f4c1802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.467+0000 7f4c27200640 1 -- 172.21.15.7:0/1773576101 shutdown_connections 2024-09-13T18:08:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.467+0000 7f4c27200640 1 --2- 172.21.15.7:0/1773576101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c280fe770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.467+0000 7f4c27200640 1 -- 172.21.15.7:0/1773576101 >> 172.21.15.7:0/1773576101 conn(0x7f4c280fa190 msgr2=0x7f4c280fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.467+0000 7f4c27200640 1 -- 172.21.15.7:0/1773576101 shutdown_connections 2024-09-13T18:08:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.467+0000 7f4c27200640 1 -- 172.21.15.7:0/1773576101 wait complete. 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.468+0000 7f4c27200640 1 Processor -- start 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.468+0000 7f4c27200640 1 -- start start 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.468+0000 7f4c27200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c28197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.468+0000 7f4c27200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c281975d0 con 0x7f4c280fe390 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.469+0000 7f4c25e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c28197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.469+0000 7f4c25e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c28197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57844/0 (socket says 172.21.15.7:57844) 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.469+0000 7f4c25e00640 1 -- 172.21.15.7:0/3125639223 learned_addr learned my addr 172.21.15.7:0/3125639223 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:08:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.469+0000 7f4c25e00640 1 -- 172.21.15.7:0/3125639223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18009560 con 0x7f4c280fe390 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.469+0000 7f4c25e00640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c28197090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009230 tx=0x7f4c18004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.470+0000 7f4c1ea00640 1 -- 172.21.15.7:0/3125639223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c180054d0 con 0x7f4c280fe390 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.470+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c281977d0 con 0x7f4c280fe390 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.470+0000 7f4c1ea00640 1 -- 172.21.15.7:0/3125639223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c18003ab0 con 0x7f4c280fe390 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.470+0000 7f4c1ea00640 1 -- 172.21.15.7:0/3125639223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c1803c940 con 0x7f4c280fe390 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.470+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c28197bf0 con 0x7f4c280fe390 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.471+0000 7f4c1ea00640 1 -- 172.21.15.7:0/3125639223 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f4c180035f0 con 0x7f4c280fe390 2024-09-13T18:08:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.471+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c280687a0 con 0x7f4c280fe390 2024-09-13T18:08:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.471+0000 7f4c1ea00640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c0c038760 0x7f4c0c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.471+0000 7f4c1ea00640 1 -- 172.21.15.7:0/3125639223 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4c1806c360 con 0x7f4c280fe390 2024-09-13T18:08:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.472+0000 7f4c1fe00640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c0c038760 0x7f4c0c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.472+0000 7f4c1fe00640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c0c038760 0x7f4c0c03ac20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c100098c0 tx=0x7f4c10006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:47.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.476+0000 7f4c1ea00640 1 -- 172.21.15.7:0/3125639223 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4c1804d530 con 0x7f4c280fe390 2024-09-13T18:08:47.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:47.660+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4c2810bb80 con 0x7f4c280fe390 2024-09-13T18:08:48.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.150+0000 7f4c1ea00640 1 -- 172.21.15.7:0/3125639223 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4c18035090 con 0x7f4c280fe390 2024-09-13T18:08:48.153 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-13T18:08:48.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c0c038760 msgr2=0x7f4c0c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c0c038760 0x7f4c0c03ac20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c100098c0 tx=0x7f4c10006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 msgr2=0x7f4c28197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c28197090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009230 tx=0x7f4c18004e50 comp rx=0 tx=0).stop 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 shutdown_connections 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c0c038760 0x7f4c0c03ac20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 --2- 172.21.15.7:0/3125639223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c280fe390 0x7f4c28197090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 >> 172.21.15.7:0/3125639223 conn(0x7f4c280fa190 msgr2=0x7f4c280fb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 shutdown_connections 2024-09-13T18:08:48.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:08:48.153+0000 7f4c27200640 1 -- 172.21.15.7:0/3125639223 wait complete. 2024-09-13T18:08:48.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:48 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3125639223' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T18:08:48.835 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-09-13T18:08:48.835 INFO:tasks.cephadm:Adding mon.b on smithi067 2024-09-13T18:08:48.835 INFO:tasks.cephadm:Adding mon.c on smithi116 2024-09-13T18:08:48.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi067:172.21.15.67=b;smithi116:172.21.15.116=c' 2024-09-13T18:08:49.030 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:08:49.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:49 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3125639223' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T18:08:49.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:49 smithi007 ceph-mon[30588]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:08:49.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:49 smithi007 ceph-mon[30588]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:50.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.397+0000 7f088f840640 1 -- 172.21.15.116:0/3673112150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 msgr2=0x7f0888104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:50.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.397+0000 7f088f840640 1 --2- 172.21.15.116:0/3673112150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888104ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0884009880 tx=0x7f088402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:50.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.397+0000 7f088f840640 1 -- 172.21.15.116:0/3673112150 shutdown_connections 2024-09-13T18:08:50.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.397+0000 7f088f840640 1 --2- 172.21.15.116:0/3673112150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888104ae0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:50.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.397+0000 7f088f840640 1 -- 172.21.15.116:0/3673112150 >> 172.21.15.116:0/3673112150 conn(0x7f08880fa440 msgr2=0x7f08880fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.397+0000 7f088f840640 1 -- 172.21.15.116:0/3673112150 shutdown_connections 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.397+0000 7f088f840640 1 -- 172.21.15.116:0/3673112150 wait complete. 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.398+0000 7f088f840640 1 Processor -- start 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.398+0000 7f088f840640 1 -- start start 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.398+0000 7f088f840640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.398+0000 7f088f840640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0888068e90 con 0x7f0888104700 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.398+0000 7f088d5dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f088d5dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.116:43680/0 (socket says 172.21.15.116:43680) 2024-09-13T18:08:50.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f088d5dc640 1 -- 172.21.15.116:0/1866302369 learned_addr learned my addr 172.21.15.116:0/1866302369 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f088d5dc640 1 -- 172.21.15.116:0/1866302369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884009560 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f088d5dc640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888195c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f08840318a0 tx=0x7f0884004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f087e7fc640 1 -- 172.21.15.116:0/1866302369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0884005140 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08881961c0 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f087e7fc640 1 -- 172.21.15.116:0/1866302369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0884004030 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0888196640 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.399+0000 7f087e7fc640 1 -- 172.21.15.116:0/1866302369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0884003b10 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.400+0000 7f087e7fc640 1 -- 172.21.15.116:0/1866302369 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f0884003c70 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.400+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08880ffe40 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.401+0000 7f087e7fc640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0874038710 0x7f087403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.401+0000 7f087e7fc640 1 -- 172.21.15.116:0/1866302369 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f088406c930 con 0x7f0888104700 2024-09-13T18:08:50.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.401+0000 7f088cddb640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0874038710 0x7f087403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:50.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.402+0000 7f088cddb640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0874038710 0x7f087403abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f08780098c0 tx=0x7f0878006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:50.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.406+0000 7f087e7fc640 1 -- 172.21.15.116:0/1866302369 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f088403b3d0 con 0x7f0888104700 2024-09-13T18:08:50.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.579+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi067:172.21.15.67=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f0888196990 con 0x7f0874038710 2024-09-13T18:08:50.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.586+0000 7f087e7fc640 1 -- 172.21.15.116:0/1866302369 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0888196990 con 0x7f0874038710 2024-09-13T18:08:50.589 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mon update... 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0874038710 msgr2=0x7f087403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0874038710 0x7f087403abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f08780098c0 tx=0x7f0878006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 msgr2=0x7f0888195c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888195c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f08840318a0 tx=0x7f0884004a30 comp rx=0 tx=0).stop 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 shutdown_connections 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0874038710 0x7f087403abd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 --2- 172.21.15.116:0/1866302369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0888104700 0x7f0888195c20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:50.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 >> 172.21.15.116:0/1866302369 conn(0x7f08880fa440 msgr2=0x7f08880fb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:50.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 shutdown_connections 2024-09-13T18:08:50.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:50.588+0000 7f088f840640 1 -- 172.21.15.116:0/1866302369 wait complete. 2024-09-13T18:08:51.157 DEBUG:teuthology.orchestra.run.smithi067:mon.b> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T18:08:51.161 DEBUG:teuthology.orchestra.run.smithi116:mon.c> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T18:08:51.163 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T18:08:51.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:08:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:51.799 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:08:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:52 smithi007 ceph-mon[30588]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi067:172.21.15.67=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:52 smithi007 ceph-mon[30588]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi067:172.21.15.67=b;smithi116:172.21.15.116=c;count:3 2024-09-13T18:08:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:52 smithi007 ceph-mon[30588]: Deploying daemon mon.c on smithi116 2024-09-13T18:08:53.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:53 smithi007 ceph-mon[30588]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.190+0000 7fad85e13640 1 -- 172.21.15.116:0/2145571353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 msgr2=0x7fad80104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.190+0000 7fad85e13640 1 --2- 172.21.15.116:0/2145571353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80104a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fad70009880 tx=0x7fad7002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 -- 172.21.15.116:0/2145571353 shutdown_connections 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 --2- 172.21.15.116:0/2145571353 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80104a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 -- 172.21.15.116:0/2145571353 >> 172.21.15.116:0/2145571353 conn(0x7fad80075490 msgr2=0x7fad800fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 -- 172.21.15.116:0/2145571353 shutdown_connections 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 -- 172.21.15.116:0/2145571353 wait complete. 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 Processor -- start 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 -- start start 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:54.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.191+0000 7fad85e13640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad801954f0 con 0x7fad80104650 2024-09-13T18:08:54.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.192+0000 7fad7f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.192+0000 7fad7f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.116:43708/0 (socket says 172.21.15.116:43708) 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.192+0000 7fad7f7fe640 1 -- 172.21.15.116:0/3605903088 learned_addr learned my addr 172.21.15.116:0/3605903088 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.192+0000 7fad7f7fe640 1 -- 172.21.15.116:0/3605903088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70009560 con 0x7fad80104650 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.193+0000 7fad7f7fe640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80194fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad70009230 tx=0x7fad70004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.193+0000 7fad7cff9640 1 -- 172.21.15.116:0/3605903088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad700053c0 con 0x7fad80104650 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.193+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad80195750 con 0x7fad80104650 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.193+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad80195bd0 con 0x7fad80104650 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.193+0000 7fad7cff9640 1 -- 172.21.15.116:0/3605903088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad70005520 con 0x7fad80104650 2024-09-13T18:08:54.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.193+0000 7fad7cff9640 1 -- 172.21.15.116:0/3605903088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad7003c860 con 0x7fad80104650 2024-09-13T18:08:54.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.194+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad60005250 con 0x7fad80104650 2024-09-13T18:08:54.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.194+0000 7fad7cff9640 1 -- 172.21.15.116:0/3605903088 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7fad700035f0 con 0x7fad80104650 2024-09-13T18:08:54.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.194+0000 7fad7cff9640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad6c038710 0x7fad6c03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:54.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.194+0000 7fad7cff9640 1 -- 172.21.15.116:0/3605903088 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fad7006c460 con 0x7fad80104650 2024-09-13T18:08:54.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.194+0000 7fad7effd640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad6c038710 0x7fad6c03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:54.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.195+0000 7fad7effd640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad6c038710 0x7fad6c03abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad680098c0 tx=0x7fad68006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:54.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.199+0000 7fad7cff9640 1 -- 172.21.15.116:0/3605903088 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad7003a360 con 0x7fad80104650 2024-09-13T18:08:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.429+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fad600050c0 con 0x7fad80104650 2024-09-13T18:08:54.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.429+0000 7fad7cff9640 1 -- 172.21.15.116:0/3605903088 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7fad70035090 con 0x7fad80104650 2024-09-13T18:08:54.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:08:54.432 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","modified":"2024-09-13T18:07:03.283191Z","created":"2024-09-13T18:07:03.283191Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:08:54.432 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2024-09-13T18:08:54.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad6c038710 msgr2=0x7fad6c03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:54.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad6c038710 0x7fad6c03abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad680098c0 tx=0x7fad68006db0 comp rx=0 tx=0).stop 2024-09-13T18:08:54.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 msgr2=0x7fad80194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:54.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80194fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad70009230 tx=0x7fad70004e10 comp rx=0 tx=0).stop 2024-09-13T18:08:54.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 shutdown_connections 2024-09-13T18:08:54.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad6c038710 0x7fad6c03abd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:54.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 --2- 172.21.15.116:0/3605903088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80104650 0x7fad80194fb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:54.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 >> 172.21.15.116:0/3605903088 conn(0x7fad80075490 msgr2=0x7fad800676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:54.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 shutdown_connections 2024-09-13T18:08:54.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:08:54.432+0000 7fad85e13640 1 -- 172.21.15.116:0/3605903088 wait complete. 2024-09-13T18:08:54.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:54 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/3605903088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:08:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:08:55 smithi007 ceph-mon[30588]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:55.902 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:55 smithi116 systemd[1]: Starting Ceph mon.c for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:08:56.153 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:55 smithi116 podman[35090]: 2024-09-13 18:08:55.802951827 +0000 UTC m=+0.015895324 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:56.153 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:55 smithi116 podman[35090]: 2024-09-13 18:08:55.905250828 +0000 UTC m=+0.118194366 container create 53e5bb6fa532fd98743bbf1145edcd70a45e6461b22a0e4fc6fdef7e41fb4add (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:08:56.153 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 podman[35090]: 2024-09-13 18:08:56.123601688 +0000 UTC m=+0.336545185 container init 53e5bb6fa532fd98743bbf1145edcd70a45e6461b22a0e4fc6fdef7e41fb4add (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T18:08:56.153 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 podman[35090]: 2024-09-13 18:08:56.127117523 +0000 UTC m=+0.340061025 container start 53e5bb6fa532fd98743bbf1145edcd70a45e6461b22a0e4fc6fdef7e41fb4add (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T18:08:56.154 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T18:08:56.154 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T18:08:56.154 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pidfile_write: ignore empty --pid-file 2024-09-13T18:08:56.154 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: load: jerasure load: lrc 2024-09-13T18:08:56.252 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T18:08:56.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:08:56.448 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: RocksDB version: 7.9.2 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Git sha 0 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: DB SUMMARY 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: DB Session ID: HHQC6LFEA18BHCPFP4GU 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: CURRENT file: CURRENT 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T18:08:56.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.error_if_exists: 0 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.create_if_missing: 0 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.paranoid_checks: 1 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.env: 0x56225f0b0bc0 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.info_log: 0x562260e7ebe0 2024-09-13T18:08:56.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.statistics: (nil) 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.use_fsync: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_log_file_size: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.allow_fallocate: 1 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.use_direct_reads: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T18:08:56.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T18:08:56.464 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.db_log_dir: 2024-09-13T18:08:56.464 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.wal_dir: 2024-09-13T18:08:56.464 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T18:08:56.464 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T18:08:56.464 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T18:08:56.464 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.write_buffer_manager: 0x562260e8c320 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T18:08:56.466 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.unordered_write: 0 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.row_cache: None 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.wal_filter: None 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T18:08:56.467 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.two_write_queues: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.wal_compression: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.atomic_flush: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.log_readahead_size: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T18:08:56.468 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_background_jobs: 2 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_background_compactions: -1 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_subcompactions: 1 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T18:08:56.469 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_open_files: -1 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_background_flushes: -1 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Compression algorithms supported: 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kZSTD supported: 0 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kXpressCompression supported: 0 2024-09-13T18:08:56.470 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kBZip2Compression supported: 0 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kLZ4Compression supported: 1 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kZlibCompression supported: 1 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: kSnappyCompression supported: 1 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.merge_operator: 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_filter: None 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T18:08:56.471 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562260e7e7e0) 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: cache_index_and_filter_blocks: 1 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: pin_top_level_index_and_filter: 1 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_type: 0 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: data_block_index_type: 0 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_shortening: 1 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T18:08:56.472 INFO:journalctl@ceph.mon.c.smithi116.stdout: checksum: 4 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: no_block_cache: 0 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache: 0x562260e73350 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_name: BinnedLRUCache 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_options: 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: capacity : 536870912 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: num_shard_bits : 4 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: strict_capacity_limit : 0 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: high_pri_pool_ratio: 0.000 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_compressed: (nil) 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: persistent_cache: (nil) 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_size: 4096 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_size_deviation: 10 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_restart_interval: 16 2024-09-13T18:08:56.473 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_block_restart_interval: 1 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: metadata_block_size: 4096 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: partition_filters: 0 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: use_delta_encoding: 1 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: filter_policy: bloomfilter 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: whole_key_filtering: 1 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: verify_compression: 0 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: read_amp_bytes_per_bit: 0 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: format_version: 5 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: enable_index_compression: 1 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_align: 0 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: max_auto_readahead_size: 262144 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: prepopulate_block_cache: 0 2024-09-13T18:08:56.474 INFO:journalctl@ceph.mon.c.smithi116.stdout: initial_auto_readahead_size: 8192 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression: NoCompression 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.num_levels: 7 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T18:08:56.475 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:08:56.476 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T18:08:56.477 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T18:08:56.478 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.inplace_update_support: 0 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T18:08:56.479 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.bloom_locality: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.max_successive_merges: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.ttl: 2592000 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.enable_blob_files: false 2024-09-13T18:08:56.480 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.min_blob_size: 0 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fbe09282-606d-4690-a7ca-d63c9ce7d98b 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250936153691, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T18:08:56.481 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250936154087, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726250936, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fbe09282-606d-4690-a7ca-d63c9ce7d98b", "db_session_id": "HHQC6LFEA18BHCPFP4GU", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250936154183, "job": 1, "event": "recovery_finished"} 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562260e9ee00 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: DB pointer 0x562260f92000 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** DB Stats ** 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:08:56.482 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** Compaction Stats [default] ** 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** Compaction Stats [default] ** 2024-09-13T18:08:56.483 INFO:journalctl@ceph.mon.c.smithi116.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:08:56.484 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout: Block cache BinnedLRUCache@0x562260e73350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: using public_addr v2:172.21.15.116:0/0 -> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: starting mon.c rank -1 at public addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] at bind addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(???) e0 preinit fsid d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).mds e1 new map 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-13T18:08:56.485 INFO:journalctl@ceph.mon.c.smithi116.stdout: e1 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout: legacy client fscid: -1 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout: No filesystems configured 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:08:56.486 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Added host smithi067 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.487 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.488 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Deploying cephadm binary to smithi116 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Added host smithi116 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.489 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Updating smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.490 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3125639223' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3125639223' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:08:56.491 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi067:172.21.15.67=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi067:172.21.15.67=b;smithi116:172.21.15.116=c;count:3 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: Deploying daemon mon.c on smithi116 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/3605903088' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 ceph-mon[35109]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 bash[35090]: 53e5bb6fa532fd98743bbf1145edcd70a45e6461b22a0e4fc6fdef7e41fb4add 2024-09-13T18:08:56.492 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:08:56 smithi116 systemd[1]: Started Ceph mon.c for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: mon.a calling monitor election 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: mon.c calling monitor election 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: monmap e2: 2 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: fsmap 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: mgrmap e13: x(active, since 52s) 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: overall HEALTH_OK 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:01.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:09:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: mon.a calling monitor election 2024-09-13T18:09:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: mon.c calling monitor election 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: monmap e2: 2 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: fsmap 2024-09-13T18:09:01.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:01.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: mgrmap e13: x(active, since 52s) 2024-09-13T18:09:01.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: overall HEALTH_OK 2024-09-13T18:09:01.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:01.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:01.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:01.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:01.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:01.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.547+0000 7fa42cf0b640 1 -- 172.21.15.116:0/2556583393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428105a20 msgr2=0x7fa414005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:01.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.547+0000 7fa42cf0b640 1 --2- 172.21.15.116:0/2556583393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428105a20 0x7fa414005580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa418014d10 tx=0x7fa41802c570 comp rx=0 tx=0).stop 2024-09-13T18:09:01.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.547+0000 7fa42cf0b640 1 -- 172.21.15.116:0/2556583393 shutdown_connections 2024-09-13T18:09:01.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.547+0000 7fa42cf0b640 1 --2- 172.21.15.116:0/2556583393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428105a20 0x7fa414005580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:01.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.547+0000 7fa42cf0b640 1 -- 172.21.15.116:0/2556583393 >> 172.21.15.116:0/2556583393 conn(0x7fa428074620 msgr2=0x7fa428074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:01.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.548+0000 7fa42cf0b640 1 -- 172.21.15.116:0/2556583393 shutdown_connections 2024-09-13T18:09:01.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.548+0000 7fa42cf0b640 1 -- 172.21.15.116:0/2556583393 wait complete. 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42cf0b640 1 Processor -- start 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42cf0b640 1 -- start start 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42cf0b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 0x7fa4281951e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42cf0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428195720 0x7fa428199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42cf0b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428195c90 con 0x7fa428195720 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42cf0b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428195e00 con 0x7fa428105a20 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 0x7fa4281951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:01.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 0x7fa4281951e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40036/0 (socket says 172.21.15.116:40036) 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42659c640 1 -- 172.21.15.116:0/1830953847 learned_addr learned my addr 172.21.15.116:0/1830953847 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42659c640 1 -- 172.21.15.116:0/1830953847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 msgr2=0x7fa4281951e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42659c640 1 -- 172.21.15.116:0/1830953847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 msgr2=0x7fa4281951e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42659c640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 0x7fa4281951e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa42659c640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 0x7fa4281951e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.549+0000 7fa41ffff640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428195720 0x7fa428199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa41ffff640 1 -- 172.21.15.116:0/1830953847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 msgr2=0x7fa4281951e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa41ffff640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 0x7fa4281951e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa41ffff640 1 -- 172.21.15.116:0/1830953847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4180149f0 con 0x7fa428195720 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa41ffff640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428195720 0x7fa428199b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa41000b3d0 tx=0x7fa41000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa41f7fe640 1 -- 172.21.15.116:0/1830953847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fa410011630 con 0x7fa428195720 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42819a060 con 0x7fa428195720 2024-09-13T18:09:01.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa41f7fe640 1 -- 172.21.15.116:0/1830953847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa410011c50 con 0x7fa428195720 2024-09-13T18:09:01.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa41f7fe640 1 -- 172.21.15.116:0/1830953847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fa410010d10 con 0x7fa428195720 2024-09-13T18:09:01.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.550+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42819a630 con 0x7fa428195720 2024-09-13T18:09:01.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.551+0000 7fa41f7fe640 1 -- 172.21.15.116:0/1830953847 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7fa41001a400 con 0x7fa428195720 2024-09-13T18:09:01.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.551+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa428105200 con 0x7fa428195720 2024-09-13T18:09:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.552+0000 7fa41f7fe640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4080384f0 0x7fa40803a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.552+0000 7fa41f7fe640 1 -- 172.21.15.116:0/1830953847 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa41004afe0 con 0x7fa428195720 2024-09-13T18:09:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.552+0000 7fa42659c640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4080384f0 0x7fa40803a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:01.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.553+0000 7fa42659c640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4080384f0 0x7fa40803a9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa418005940 tx=0x7fa4180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:01.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.557+0000 7fa41f7fe640 1 -- 172.21.15.116:0/1830953847 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4100176a0 con 0x7fa428195720 2024-09-13T18:09:01.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.780+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa4281010b0 con 0x7fa428195720 2024-09-13T18:09:01.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.780+0000 7fa41f7fe640 1 -- 172.21.15.116:0/1830953847 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7fa4100172c0 con 0x7fa428195720 2024-09-13T18:09:01.783 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:09:01.783 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":2,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","modified":"2024-09-13T18:08:56.186065Z","created":"2024-09-13T18:07:03.283191Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T18:09:01.784 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 2 2024-09-13T18:09:01.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4080384f0 msgr2=0x7fa40803a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:01.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4080384f0 0x7fa40803a9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa418005940 tx=0x7fa4180058d0 comp rx=0 tx=0).stop 2024-09-13T18:09:01.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428195720 msgr2=0x7fa428199b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:01.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428195720 0x7fa428199b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa41000b3d0 tx=0x7fa41000b890 comp rx=0 tx=0).stop 2024-09-13T18:09:01.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 shutdown_connections 2024-09-13T18:09:01.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4080384f0 0x7fa40803a9b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:01.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa428195720 0x7fa428199b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:01.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 --2- 172.21.15.116:0/1830953847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa428105a20 0x7fa4281951e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:01.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 >> 172.21.15.116:0/1830953847 conn(0x7fa428074620 msgr2=0x7fa4280fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:01.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 shutdown_connections 2024-09-13T18:09:01.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:01.783+0000 7fa42cf0b640 1 -- 172.21.15.116:0/1830953847 wait complete. 2024-09-13T18:09:02.372 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:02 smithi116 ceph-mon[35109]: Deploying daemon mon.b on smithi067 2024-09-13T18:09:02.372 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:02 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/1830953847' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:09:02.373 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:02 smithi007 ceph-mon[30588]: Deploying daemon mon.b on smithi067 2024-09-13T18:09:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:02 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/1830953847' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:09:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:03.377 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T18:09:03.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:09:03.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:03 smithi007 ceph-mon[30588]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:03.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:09:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:09:03.186+0000 7fbb59800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:09:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:09:03.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:03 smithi116 ceph-mon[35109]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:04.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 -- 172.21.15.116:0/3036497132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 msgr2=0x7fc218105c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 --2- 172.21.15.116:0/3036497132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 0x7fc218105c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc210009880 tx=0x7fc21002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 -- 172.21.15.116:0/3036497132 shutdown_connections 2024-09-13T18:09:04.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 --2- 172.21.15.116:0/3036497132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 0x7fc218105c90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 -- 172.21.15.116:0/3036497132 >> 172.21.15.116:0/3036497132 conn(0x7fc2180fb5b0 msgr2=0x7fc2180fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 -- 172.21.15.116:0/3036497132 shutdown_connections 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 -- 172.21.15.116:0/3036497132 wait complete. 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 Processor -- start 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.955+0000 7fc2207a8640 1 -- start start 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc2207a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 0x7fc2181952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc2207a8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 0x7fc218199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc2207a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218195d70 con 0x7fc2181058b0 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc2207a8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218195ee0 con 0x7fc218195800 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21dd43640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 0x7fc218199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21dd43640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 0x7fc218199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40048/0 (socket says 172.21.15.116:40048) 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21dd43640 1 -- 172.21.15.116:0/1030614091 learned_addr learned my addr 172.21.15.116:0/1030614091 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:09:04.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21dd43640 1 -- 172.21.15.116:0/1030614091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 msgr2=0x7fc218199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21dd43640 1 -- 172.21.15.116:0/1030614091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 msgr2=0x7fc218199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21dd43640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 0x7fc218199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21dd43640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 0x7fc218199c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21e544640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 0x7fc2181952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21e544640 1 -- 172.21.15.116:0/1030614091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 msgr2=0x7fc218199c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21e544640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 0x7fc218199c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21e544640 1 -- 172.21.15.116:0/1030614091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009560 con 0x7fc2181058b0 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.956+0000 7fc21e544640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 0x7fc2181952c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc210006010 tx=0x7fc210004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.957+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fc210005320 con 0x7fc2181058b0 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.957+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21819a140 con 0x7fc2181058b0 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.957+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc210005480 con 0x7fc2181058b0 2024-09-13T18:09:04.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.957+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fc21003b5e0 con 0x7fc2181058b0 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.957+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21819a690 con 0x7fc2181058b0 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.958+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc218100ff0 con 0x7fc2181058b0 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.958+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7fc2100035f0 con 0x7fc2181058b0 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.958+0000 7fc2177fe640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2000384f0 0x7fc20003a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.958+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc21006c090 con 0x7fc2181058b0 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.958+0000 7fc21dd43640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2000384f0 0x7fc20003a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.959+0000 7fc21dd43640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2000384f0 0x7fc20003a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009100 tx=0x7fc20c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:04.963+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc21003aa10 con 0x7fc2181058b0 2024-09-13T18:09:05.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:05.060+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100055f0 con 0x7fc2181058b0 2024-09-13T18:09:05.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:05.187+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc218105d10 con 0x7fc2181058b0 2024-09-13T18:09:05.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:05 smithi067 systemd[1]: Started Ceph mon.b for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:09:10.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.070+0000 7fc2177fe640 1 -- 172.21.15.116:0/1030614091 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1266 (secure 0 0 0) 0x7fc21003a3c0 con 0x7fc2181058b0 2024-09-13T18:09:10.074 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-13T18:09:10.074 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":3,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","modified":"2024-09-13T18:09:05.060104Z","created":"2024-09-13T18:07:03.283191Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T18:09:10.075 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 3 2024-09-13T18:09:10.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2000384f0 msgr2=0x7fc20003a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:10.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2000384f0 0x7fc20003a9b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009100 tx=0x7fc20c008040 comp rx=0 tx=0).stop 2024-09-13T18:09:10.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 msgr2=0x7fc2181952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:10.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 0x7fc2181952c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc210006010 tx=0x7fc210004c60 comp rx=0 tx=0).stop 2024-09-13T18:09:10.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 shutdown_connections 2024-09-13T18:09:10.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2000384f0 0x7fc20003a9b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:10.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc218195800 0x7fc218199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:10.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 --2- 172.21.15.116:0/1030614091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2181058b0 0x7fc2181952c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:10.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 >> 172.21.15.116:0/1030614091 conn(0x7fc2180fb5b0 msgr2=0x7fc2180fb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:10.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 shutdown_connections 2024-09-13T18:09:10.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:10.073+0000 7fc2207a8640 1 -- 172.21.15.116:0/1030614091 wait complete. 2024-09-13T18:09:10.399 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:09:10.400 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: mon.c calling monitor election 2024-09-13T18:09:10.400 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: mon.a calling monitor election 2024-09-13T18:09:10.400 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.400 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:10.400 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/1030614091' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:09:10.400 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:10.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:10.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T18:09:10.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:10.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: fsmap 2024-09-13T18:09:10.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:10.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: mgrmap e13: x(active, since 61s) 2024-09-13T18:09:10.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T18:09:10.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T18:09:10.403 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T18:09:10.403 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: mon.b (rank 2) addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] is down (out of quorum) 2024-09-13T18:09:10.403 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.403 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.403 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.403 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:09:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: mon.c calling monitor election 2024-09-13T18:09:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: mon.a calling monitor election 2024-09-13T18:09:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/1030614091' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:09:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:10.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:10.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T18:09:10.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:10.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: fsmap 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: mgrmap e13: x(active, since 61s) 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: mon.b (rank 2) addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] is down (out of quorum) 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.545 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.545 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:10.704 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T18:09:10.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T18:09:11.019 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:09:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:11 smithi007 ceph-mon[30588]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:11.434 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:11.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:11.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:11 smithi116 ceph-mon[35109]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:11.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:09:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: mon.c calling monitor election 2024-09-13T18:09:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: mon.a calling monitor election 2024-09-13T18:09:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:09:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/1030614091' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: fsmap 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:12.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: mgrmap e13: x(active, since 61s) 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: mon.b (rank 2) addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] is down (out of quorum) 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:12.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:12.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.969+0000 7f01e0a00640 1 -- 172.21.15.7:0/2084153568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 msgr2=0x7f01dc105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.969+0000 7f01e0a00640 1 --2- 172.21.15.7:0/2084153568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc105a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009880 tx=0x7f01cc02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.969+0000 7f01e0a00640 1 -- 172.21.15.7:0/2084153568 shutdown_connections 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.969+0000 7f01e0a00640 1 --2- 172.21.15.7:0/2084153568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc105a20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.969+0000 7f01e0a00640 1 -- 172.21.15.7:0/2084153568 >> 172.21.15.7:0/2084153568 conn(0x7f01dc0fb230 msgr2=0x7f01dc0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.970+0000 7f01e0a00640 1 -- 172.21.15.7:0/2084153568 shutdown_connections 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.970+0000 7f01e0a00640 1 -- 172.21.15.7:0/2084153568 wait complete. 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.970+0000 7f01e0a00640 1 Processor -- start 2024-09-13T18:09:12.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01e0a00640 1 -- start start 2024-09-13T18:09:12.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01e0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01e0a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc197740 0x7f01dc19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01e0a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01dc19c080 0x7f01dc19c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01e0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc197e10 con 0x7f01dc105640 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01e0a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1a3df0 con 0x7f01dc197740 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01e0a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1a3f30 con 0x7f01dc19c080 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36094/0 (socket says 172.21.15.7:36094) 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01db400640 1 -- 172.21.15.7:0/4216220870 learned_addr learned my addr 172.21.15.7:0/4216220870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.971+0000 7f01daa00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc197740 0x7f01dc19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.972+0000 7f01dbe00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01dc19c080 0x7f01dc19c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.972+0000 7f01db400640 1 -- 172.21.15.7:0/4216220870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01dc19c080 msgr2=0x7f01dc19c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.972+0000 7f01db400640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01dc19c080 0x7f01dc19c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:12.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.972+0000 7f01db400640 1 -- 172.21.15.7:0/4216220870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc197740 msgr2=0x7f01dc19bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:12.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.972+0000 7f01db400640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc197740 0x7f01dc19bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:12.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.972+0000 7f01db400640 1 -- 172.21.15.7:0/4216220870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009560 con 0x7f01dc105640 2024-09-13T18:09:12.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.972+0000 7f01db400640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc197200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009230 tx=0x7f01cc003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:12.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.973+0000 7f01d3e00640 1 -- 172.21.15.7:0/4216220870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc005460 con 0x7f01dc105640 2024-09-13T18:09:12.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.973+0000 7f01d3e00640 1 -- 172.21.15.7:0/4216220870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01cc0055c0 con 0x7f01dc105640 2024-09-13T18:09:12.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.973+0000 7f01d3e00640 1 -- 172.21.15.7:0/4216220870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc031a80 con 0x7f01dc105640 2024-09-13T18:09:12.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.973+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc1a41e0 con 0x7f01dc105640 2024-09-13T18:09:12.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.973+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc1a4660 con 0x7f01dc105640 2024-09-13T18:09:12.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.974+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc100cb0 con 0x7f01dc105640 2024-09-13T18:09:12.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.975+0000 7f01d3e00640 1 -- 172.21.15.7:0/4216220870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f01cc0046c0 con 0x7f01dc105640 2024-09-13T18:09:12.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.975+0000 7f01d3e00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f01c0038be0 0x7f01c003b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:12.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.975+0000 7f01d3e00640 1 -- 172.21.15.7:0/4216220870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f01cc06c350 con 0x7f01dc105640 2024-09-13T18:09:12.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.975+0000 7f01daa00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f01c0038be0 0x7f01c003b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:12.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.976+0000 7f01daa00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f01c0038be0 0x7f01c003b0a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009a30 tx=0x7f01c8009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:12.982+0000 7f01d3e00640 1 -- 172.21.15.7:0/4216220870 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f01cc044450 con 0x7f01dc105640 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: mon.b calling monitor election 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Updating smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Updating smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Updating smithi007:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: mon.b calling monitor election 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: mon.c calling monitor election 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: mon.a calling monitor election 2024-09-13T18:09:13.139 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: fsmap 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: mgrmap e13: x(active, since 63s) 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: Cluster is now healthy 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: overall HEALTH_OK 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.140 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.141 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.141 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:13.141 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:13.141 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.171+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f01dc109890 con 0x7f01dc105640 2024-09-13T18:09:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.172+0000 7f01d3e00640 1 -- 172.21.15.7:0/4216220870 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+271 (secure 0 0 0) 0x7f01cc03f120 con 0x7f01dc105640 2024-09-13T18:09:13.174 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:09:13.174 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-13T18:09:13.174 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:09:13.174 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f01c0038be0 msgr2=0x7f01c003b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f01c0038be0 0x7f01c003b0a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009a30 tx=0x7f01c8009190 comp rx=0 tx=0).stop 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 msgr2=0x7f01dc197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc197200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009230 tx=0x7f01cc003cd0 comp rx=0 tx=0).stop 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 shutdown_connections 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f01c0038be0 0x7f01c003b0a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01dc19c080 0x7f01dc19c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01dc197740 0x7f01dc19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 --2- 172.21.15.7:0/4216220870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01dc105640 0x7f01dc197200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 >> 172.21.15.7:0/4216220870 conn(0x7f01dc0fb230 msgr2=0x7f01dc0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 shutdown_connections 2024-09-13T18:09:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:13.174+0000 7f01e0a00640 1 -- 172.21.15.7:0/4216220870 wait complete. 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: mon.b calling monitor election 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Updating smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Updating smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Updating smithi007:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: mon.b calling monitor election 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: mon.c calling monitor election 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: mon.a calling monitor election 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: fsmap 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: mgrmap e13: x(active, since 63s) 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: Cluster is now healthy 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: overall HEALTH_OK 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:13.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: mon.b calling monitor election 2024-09-13T18:09:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-13T18:09:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-13T18:09:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Updating smithi116:/etc/ceph/ceph.conf 2024-09-13T18:09:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Updating smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Updating smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Updating smithi007:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: mon.b calling monitor election 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: mon.c calling monitor election 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: mon.a calling monitor election 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: monmap e3: 3 mons at {a=[v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0],b=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: fsmap 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: mgrmap e13: x(active, since 63s) 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: Cluster is now healthy 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: overall HEALTH_OK 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:14.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:14 smithi007 ceph-mon[30588]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T18:09:14.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:14 smithi007 ceph-mon[30588]: Reconfiguring daemon mon.a on smithi007 2024-09-13T18:09:14.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:14.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:14 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/4216220870' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:14.187 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:14.370 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T18:09:14.370 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:09:14.370 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T18:09:14.428 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:09:14.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:09:14.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:14 smithi116 ceph-mon[35109]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T18:09:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:14 smithi116 ceph-mon[35109]: Reconfiguring daemon mon.a on smithi007 2024-09-13T18:09:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:14 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/4216220870' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:14 smithi067 ceph-mon[35103]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T18:09:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:14 smithi067 ceph-mon[35103]: Reconfiguring daemon mon.a on smithi007 2024-09-13T18:09:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:09:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:14 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/4216220870' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:14.525 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:09:14.525 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T18:09:14.558 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:09:14.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:09:14.628 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:09:14.628 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T18:09:14.661 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:09:14.661 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:09:14.730 INFO:tasks.cephadm:Adding mgr.x on smithi007 2024-09-13T18:09:14.730 INFO:tasks.cephadm:Adding mgr.y on smithi067 2024-09-13T18:09:14.730 INFO:tasks.cephadm:Adding mgr.z on smithi116 2024-09-13T18:09:14.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi007=x;smithi067=y;smithi116=z' 2024-09-13T18:09:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:15 smithi067 ceph-mon[35103]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:15.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:15 smithi007 ceph-mon[30588]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:15.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:15.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:15.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:15.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:15.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:15.315 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:15 smithi116 ceph-mon[35109]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:15.315 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:15.315 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:15.315 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:15.315 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:15.315 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:16.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:16 smithi067 ceph-mon[35103]: Reconfiguring mon.b (monmap changed)... 2024-09-13T18:09:16.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:16 smithi067 ceph-mon[35103]: Reconfiguring daemon mon.b on smithi067 2024-09-13T18:09:16.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:16 smithi007 ceph-mon[30588]: Reconfiguring mon.b (monmap changed)... 2024-09-13T18:09:16.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:16 smithi007 ceph-mon[30588]: Reconfiguring daemon mon.b on smithi067 2024-09-13T18:09:16.337 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:16 smithi116 ceph-mon[35109]: Reconfiguring mon.b (monmap changed)... 2024-09-13T18:09:16.338 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:16 smithi116 ceph-mon[35109]: Reconfiguring daemon mon.b on smithi067 2024-09-13T18:09:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 -- 172.21.15.116:0/250350643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8100380 msgr2=0x7f9ea8102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 --2- 172.21.15.116:0/250350643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8100380 0x7f9ea8102770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009c20 tx=0x7f9ea402aa90 comp rx=0 tx=0).stop 2024-09-13T18:09:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 -- 172.21.15.116:0/250350643 shutdown_connections 2024-09-13T18:09:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 --2- 172.21.15.116:0/250350643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8100380 0x7f9ea8102770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 -- 172.21.15.116:0/250350643 >> 172.21.15.116:0/250350643 conn(0x7f9ea80f9f80 msgr2=0x7f9ea80fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 -- 172.21.15.116:0/250350643 shutdown_connections 2024-09-13T18:09:16.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 -- 172.21.15.116:0/250350643 wait complete. 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 Processor -- start 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 -- start start 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ea8100380 0x7f9ea8194e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.419+0000 7f9eb0651640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ea81953a0 0x7f9ea819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eb0651640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8195820 0x7f9ea819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eb0651640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea819d130 con 0x7f9ea8195820 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eb0651640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea819d2a0 con 0x7f9ea8100380 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eb0651640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea819d460 con 0x7f9ea81953a0 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ea81953a0 0x7f9ea819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ea81953a0 0x7f9ea819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49632/0 (socket says 172.21.15.116:49632) 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 -- 172.21.15.116:0/3767841875 learned_addr learned my addr 172.21.15.116:0/3767841875 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eae3ed640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ea8100380 0x7f9ea8194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eaebee640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8195820 0x7f9ea819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 -- 172.21.15.116:0/3767841875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ea8100380 msgr2=0x7f9ea8194e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ea8100380 0x7f9ea8194e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 -- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8195820 msgr2=0x7f9ea819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8195820 0x7f9ea819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 -- 172.21.15.116:0/3767841875 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4009900 con 0x7f9ea81953a0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eadbec640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ea81953a0 0x7f9ea819a410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800b520 tx=0x7f9e9800b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9e9f7fe640 1 -- 172.21.15.116:0/3767841875 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98004230 con 0x7f9ea81953a0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9e9f7fe640 1 -- 172.21.15.116:0/3767841875 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e98004390 con 0x7f9ea81953a0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.420+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea819d740 con 0x7f9ea81953a0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.421+0000 7f9e9f7fe640 1 -- 172.21.15.116:0/3767841875 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98003c80 con 0x7f9ea81953a0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.421+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea819dcc0 con 0x7f9ea81953a0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.421+0000 7f9e9f7fe640 1 -- 172.21.15.116:0/3767841875 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7f9e98010690 con 0x7f9ea81953a0 2024-09-13T18:09:16.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.422+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea818e5f0 con 0x7f9ea81953a0 2024-09-13T18:09:16.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.422+0000 7f9e9f7fe640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9e94038be0 0x7f9e9403b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.422+0000 7f9e9f7fe640 1 -- 172.21.15.116:0/3767841875 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9e9804acd0 con 0x7f9ea81953a0 2024-09-13T18:09:16.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.422+0000 7f9eae3ed640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9e94038be0 0x7f9e9403b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.423+0000 7f9eae3ed640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9e94038be0 0x7f9e9403b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4000f80 tx=0x7f9ea403a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.427+0000 7f9e9f7fe640 1 -- 172.21.15.116:0/3767841875 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9e98003de0 con 0x7f9ea81953a0 2024-09-13T18:09:16.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.617+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi067=y;smithi116=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ea802c480 con 0x7f9e94038be0 2024-09-13T18:09:16.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.624+0000 7f9e9f7fe640 1 -- 172.21.15.116:0/3767841875 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9ea802c480 con 0x7f9e94038be0 2024-09-13T18:09:16.628 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mgr update... 2024-09-13T18:09:16.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9e94038be0 msgr2=0x7f9e9403b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9e94038be0 0x7f9e9403b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4000f80 tx=0x7f9ea403a040 comp rx=0 tx=0).stop 2024-09-13T18:09:16.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ea81953a0 msgr2=0x7f9ea819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ea81953a0 0x7f9ea819a410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9e9800b520 tx=0x7f9e9800b9e0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 shutdown_connections 2024-09-13T18:09:16.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9e94038be0 0x7f9e9403b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ea8195820 0x7f9ea819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ea81953a0 0x7f9ea819a410 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 --2- 172.21.15.116:0/3767841875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ea8100380 0x7f9ea8194e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 >> 172.21.15.116:0/3767841875 conn(0x7f9ea80f9f80 msgr2=0x7f9ea80faaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:16.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 shutdown_connections 2024-09-13T18:09:16.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:09:16.627+0000 7f9eb0651640 1 -- 172.21.15.116:0/3767841875 wait complete. 2024-09-13T18:09:17.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: Reconfiguring mon.c (monmap changed)... 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: Reconfiguring daemon mon.c on smithi116 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: Reconfiguring mon.c (monmap changed)... 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: Reconfiguring daemon mon.c on smithi116 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: Reconfiguring mon.c (monmap changed)... 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: Reconfiguring daemon mon.c on smithi116 2024-09-13T18:09:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:17.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:18.197 DEBUG:teuthology.orchestra.run.smithi067:mgr.y> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.y.service 2024-09-13T18:09:18.200 DEBUG:teuthology.orchestra.run.smithi116:mgr.z> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.z.service 2024-09-13T18:09:18.202 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T18:09:18.202 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:09:18.202 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:09:18.238 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:09:18.239 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-13T18:09:18.317 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:09:18.317 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:18.317 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-13T18:09:18.317 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:18.317 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:18.318 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 18:08:22.987886796 +0000 2024-09-13T18:09:18.318 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 18:03:56.854150450 +0000 2024-09-13T18:09:18.318 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 18:03:56.854150450 +0000 2024-09-13T18:09:18.318 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 18:03:56.854150450 +0000 2024-09-13T18:09:18.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:09:18.415 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T18:09:18.415 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T18:09:18.415 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000187764 s, 2.7 MB/s 2024-09-13T18:09:18.418 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:09:18.456 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-13T18:09:18.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:18 smithi116 ceph-mon[35109]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi067=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:18.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:18 smithi116 ceph-mon[35109]: Saving service mgr spec with placement smithi007=x;smithi067=y;smithi116=z;count:3 2024-09-13T18:09:18.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:18.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:18.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:18.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:18 smithi067 ceph-mon[35103]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi067=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:18.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:18 smithi067 ceph-mon[35103]: Saving service mgr spec with placement smithi007=x;smithi067=y;smithi116=z;count:3 2024-09-13T18:09:18.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:18.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:18.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 18:08:23.037886015 +0000 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 18:03:57.327143341 +0000 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 18:03:57.327143341 +0000 2024-09-13T18:09:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 18:03:57.327143341 +0000 2024-09-13T18:09:18.534 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:09:18.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:18 smithi007 ceph-mon[30588]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi067=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:18.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:18 smithi007 ceph-mon[30588]: Saving service mgr spec with placement smithi007=x;smithi067=y;smithi116=z;count:3 2024-09-13T18:09:18.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:18.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:18.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T18:09:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T18:09:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000182514 s, 2.8 MB/s 2024-09-13T18:09:18.595 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:09:18.632 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 18:08:23.084885282 +0000 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 18:03:57.785136458 +0000 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 18:03:57.785136458 +0000 2024-09-13T18:09:18.707 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 18:03:57.785136458 +0000 2024-09-13T18:09:18.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T18:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T18:09:18.800 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000168519 s, 3.0 MB/s 2024-09-13T18:09:18.802 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:09:18.839 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 18:08:23.129884580 +0000 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 18:03:58.369127681 +0000 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 18:03:58.369127681 +0000 2024-09-13T18:09:18.914 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 18:03:58.369127681 +0000 2024-09-13T18:09:18.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:09:19.006 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T18:09:19.007 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T18:09:19.007 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000174161 s, 2.9 MB/s 2024-09-13T18:09:19.009 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:09:19.046 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-13T18:09:19.046 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:09:19.065 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:09:19.065 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-09-13T18:09:19.123 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-13 18:09:04.496015597 +0000 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-13 18:03:25.906615388 +0000 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-13 18:03:25.906615388 +0000 2024-09-13T18:09:19.124 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-13 18:03:25.906615388 +0000 2024-09-13T18:09:19.124 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:09:19.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-13T18:09:19.192 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-13T18:09:19.192 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000279561 s, 1.8 MB/s 2024-09-13T18:09:19.193 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:09:19.251 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: Deploying daemon mgr.z on smithi116 2024-09-13T18:09:19.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:19 smithi007 ceph-mon[30588]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-13 18:09:04.497015575 +0000 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-13 18:03:26.236608132 +0000 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-13 18:03:26.236608132 +0000 2024-09-13T18:09:19.309 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-13 18:03:26.236608132 +0000 2024-09-13T18:09:19.310 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:09:19.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-13T18:09:19.378 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-13T18:09:19.378 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000229465 s, 2.2 MB/s 2024-09-13T18:09:19.379 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:09:19.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:19.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:19.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:19.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:19.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:09:19.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:19.428 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:19.429 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: Deploying daemon mgr.z on smithi116 2024-09-13T18:09:19.429 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:19 smithi116 ceph-mon[35109]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:19.436 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-09-13T18:09:19.492 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:09:19.492 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:19.492 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T18:09:19.493 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:19.493 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:19.493 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-13 18:09:04.497015575 +0000 2024-09-13T18:09:19.493 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-13 18:03:26.563600942 +0000 2024-09-13T18:09:19.493 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-13 18:03:26.563600942 +0000 2024-09-13T18:09:19.493 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-13 18:03:26.563600942 +0000 2024-09-13T18:09:19.493 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: Deploying daemon mgr.z on smithi116 2024-09-13T18:09:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:19 smithi067 ceph-mon[35103]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:19.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-13T18:09:19.521 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-13T18:09:19.521 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000196336 s, 2.6 MB/s 2024-09-13T18:09:19.522 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:09:19.579 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-09-13T18:09:19.634 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:09:19.634 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:19.634 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-13T18:09:19.635 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:19.635 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:19.635 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-13 18:09:04.497015575 +0000 2024-09-13T18:09:19.635 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-13 18:03:26.887593817 +0000 2024-09-13T18:09:19.635 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-13 18:03:26.887593817 +0000 2024-09-13T18:09:19.635 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-13 18:03:26.887593817 +0000 2024-09-13T18:09:19.635 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:09:19.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-13T18:09:19.698 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-13T18:09:19.698 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000207118 s, 2.5 MB/s 2024-09-13T18:09:19.700 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:09:19.757 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-13T18:09:19.757 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:09:19.778 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:09:19.778 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-13T18:09:19.841 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:09:19.841 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:19.842 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-13T18:09:19.842 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:19.842 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:19.842 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 18:08:55.614349276 +0000 2024-09-13T18:09:19.842 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 18:03:38.787353008 +0000 2024-09-13T18:09:19.842 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 18:03:38.787353008 +0000 2024-09-13T18:09:19.842 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 18:03:38.787353008 +0000 2024-09-13T18:09:19.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:09:19.947 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T18:09:19.947 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T18:09:19.948 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000251425 s, 2.0 MB/s 2024-09-13T18:09:19.949 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:09:19.966 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-13T18:09:20.027 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 18:09:19.898942956 +0000 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 18:03:39.147347002 +0000 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 18:03:39.147347002 +0000 2024-09-13T18:09:20.028 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 18:03:39.147347002 +0000 2024-09-13T18:09:20.028 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000212403 s, 2.4 MB/s 2024-09-13T18:09:20.142 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:09:20.158 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-13T18:09:20.210 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 systemd[1]: Starting Ceph mgr.z for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:09:20.216 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:09:20.216 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:20.216 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T18:09:20.216 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:20.216 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:20.216 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 18:09:20.090939744 +0000 2024-09-13T18:09:20.217 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 18:03:39.506341013 +0000 2024-09-13T18:09:20.217 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 18:03:39.506341013 +0000 2024-09-13T18:09:20.217 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 18:03:39.506341013 +0000 2024-09-13T18:09:20.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:09:20.284 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T18:09:20.284 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T18:09:20.284 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00017599 s, 2.9 MB/s 2024-09-13T18:09:20.285 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:09:20.341 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-13T18:09:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-13 18:09:20.091939727 +0000 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-13 18:03:39.850335274 +0000 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-13 18:03:39.850335274 +0000 2024-09-13T18:09:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-13 18:03:39.850335274 +0000 2024-09-13T18:09:20.398 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:09:20.464 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-13T18:09:20.464 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-13T18:09:20.464 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000199225 s, 2.6 MB/s 2024-09-13T18:09:20.465 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:09:20.524 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-09-13T18:09:20.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T18:09:20.609 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 podman[36830]: 2024-09-13 18:09:20.267526712 +0000 UTC m=+0.016759187 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:09:20.609 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 podman[36830]: 2024-09-13 18:09:20.379644215 +0000 UTC m=+0.128876680 container create 1b6276b2a3447eaa45ba1e081b15e563b5e10033779548aedc02d7baae65576c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T18:09:20.609 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 podman[36830]: 2024-09-13 18:09:20.607243331 +0000 UTC m=+0.356475798 container init 1b6276b2a3447eaa45ba1e081b15e563b5e10033779548aedc02d7baae65576c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T18:09:20.849 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:09:20.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 podman[36830]: 2024-09-13 18:09:20.610432682 +0000 UTC m=+0.359665149 container start 1b6276b2a3447eaa45ba1e081b15e563b5e10033779548aedc02d7baae65576c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T18:09:20.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 ceph-mgr[36945]: -- 172.21.15.116:0/383393238 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560cbb6e6d00 con 0x560cbb6ba800 2024-09-13T18:09:20.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 bash[36830]: 1b6276b2a3447eaa45ba1e081b15e563b5e10033779548aedc02d7baae65576c 2024-09-13T18:09:20.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 systemd[1]: Started Ceph mgr.z for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:09:20.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:20.731+0000 7f3f87b0e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:09:20.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:20.799+0000 7f3f87b0e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:09:21.338 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:20.977+0000 7f3f87b0e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:09:21.338 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:21.044+0000 7f3f87b0e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:09:21.338 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:21.192+0000 7f3f87b0e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:09:21.338 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:21.334+0000 7f3f87b0e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:21.649 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:09:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:21.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:21.960 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:21.645+0000 7f3f87b0e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:09:21.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:21.704+0000 7f3f87b0e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:09:21.961 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:21.881+0000 7f3f87b0e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:09:22.704 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:22 smithi067 ceph-mon[35103]: Deploying daemon mgr.y on smithi067 2024-09-13T18:09:22.704 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 systemd[1]: Starting Ceph mgr.y for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:09:22.736 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T18:09:22.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:22 smithi007 ceph-mon[30588]: Deploying daemon mgr.y on smithi067 2024-09-13T18:09:22.800 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:22 smithi116 ceph-mon[35109]: Deploying daemon mgr.y on smithi067 2024-09-13T18:09:22.800 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:22.731+0000 7f3f87b0e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:09:22.862 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T18:09:22.894 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-09-13T18:09:22.895 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-09-13T18:09:22.895 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0273091 s, 384 MB/s 2024-09-13T18:09:22.895 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-09-13T18:09:22.997 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 podman[36461]: 2024-09-13 18:09:22.702073523 +0000 UTC m=+0.097988814 container create 92d147beb16d7de3cecac056aab78f38d3cab49e0312a4435c953a4c2c495c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, ceph=True) 2024-09-13T18:09:22.997 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 podman[36461]: 2024-09-13 18:09:22.620242112 +0000 UTC m=+0.016157421 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:09:22.997 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 podman[36461]: 2024-09-13 18:09:22.913254539 +0000 UTC m=+0.309169840 container init 92d147beb16d7de3cecac056aab78f38d3cab49e0312a4435c953a4c2c495c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:09:22.998 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 podman[36461]: 2024-09-13 18:09:22.916045293 +0000 UTC m=+0.311960594 container start 92d147beb16d7de3cecac056aab78f38d3cab49e0312a4435c953a4c2c495c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T18:09:22.998 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 ceph-mgr[36479]: -- 172.21.15.67:0/2972994904 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560b567aad00 con 0x560b5677f400 2024-09-13T18:09:23.210 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:22.797+0000 7f3f87b0e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:09:23.260 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 bash[36461]: 92d147beb16d7de3cecac056aab78f38d3cab49e0312a4435c953a4c2c495c72 2024-09-13T18:09:23.260 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:22 smithi067 systemd[1]: Started Ceph mgr.y for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:09:23.260 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:23.037+0000 7f20869ef040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:09:23.260 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:23.098+0000 7f20869ef040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:09:23.260 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:23.257+0000 7f20869ef040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:09:23.550 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:23.328+0000 7f20869ef040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:23.493+0000 7f20869ef040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-mon[35103]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:23.551 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:23.542+0000 7f3f87b0e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:23.657+0000 7f3f87b0e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-mon[35109]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.773 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:23.774 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:23 smithi007 ceph-mon[30588]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:23.885 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:23.651+0000 7f20869ef040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:09:23.887 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:09:24.085 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:23.801+0000 7f3f87b0e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:09:24.086 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:23.865+0000 7f3f87b0e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:09:24.086 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.015+0000 7f3f87b0e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:09:24.086 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.083+0000 7f3f87b0e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:09:24.243 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:23.981+0000 7f20869ef040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:09:24.244 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:24.044+0000 7f20869ef040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:09:24.244 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:24.241+0000 7f20869ef040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:09:24.370 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.142+0000 7f3f87b0e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:09:24.371 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.303+0000 7f3f87b0e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:09:24.371 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.368+0000 7f3f87b0e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:09:24.637 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.436+0000 7f3f87b0e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:09:24.637 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.518+0000 7f3f87b0e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:09:24.637 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.576+0000 7f3f87b0e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:09:24.637 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:24.634+0000 7f3f87b0e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:09:25.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: Reconfiguring daemon mgr.x on smithi007 2024-09-13T18:09:25.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:25 smithi007 ceph-mon[30588]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:25.497 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:25.143+0000 7f20869ef040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:09:25.497 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:25.211+0000 7f20869ef040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:09:25.500 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: Reconfiguring daemon mgr.x on smithi007 2024-09-13T18:09:25.501 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-mon[35103]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:25.710 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z[36916]: 2024-09-13T18:09:25.404+0000 7f3f87b0e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:25.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T18:09:25.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:09:25.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:09:25.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:25.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: Reconfiguring daemon mgr.x on smithi007 2024-09-13T18:09:25.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:25 smithi116 ceph-mon[35109]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:26.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3610516114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 msgr2=0x7fe99c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3610516114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 0x7fe99c073370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe988009900 tx=0x7fe98802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3610516114 shutdown_connections 2024-09-13T18:09:26.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3610516114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 0x7fe99c10e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3610516114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 0x7fe99c073370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3610516114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe99c0744e0 0x7fe99c072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3610516114 >> 172.21.15.7:0/3610516114 conn(0x7fe99c0fb5a0 msgr2=0x7fe99c0fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:26.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3610516114 shutdown_connections 2024-09-13T18:09:26.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.106+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3610516114 wait complete. 2024-09-13T18:09:26.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.107+0000 7fe9a1c00640 1 Processor -- start 2024-09-13T18:09:26.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.107+0000 7fe9a1c00640 1 -- start start 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe9a1c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 0x7fe99c19c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe9a1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe99c0744e0 0x7fe99c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe9a1c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 0x7fe99c1a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe9a1c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c1a3eb0 con 0x7fe99c0744e0 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe9a1c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c1a4020 con 0x7fe99c10c3d0 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe9a1c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c1a41e0 con 0x7fe99c072f10 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe99b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 0x7fe99c1a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe99a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe99c0744e0 0x7fe99c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe99aa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 0x7fe99c19c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe99b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 0x7fe99c1a3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55354/0 (socket says 172.21.15.7:55354) 2024-09-13T18:09:26.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.108+0000 7fe99b400640 1 -- 172.21.15.7:0/3343270591 learned_addr learned my addr 172.21.15.7:0/3343270591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:09:26.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99b400640 1 -- 172.21.15.7:0/3343270591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 msgr2=0x7fe99c19c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99b400640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 0x7fe99c19c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99b400640 1 -- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe99c0744e0 msgr2=0x7fe99c19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99b400640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe99c0744e0 0x7fe99c19c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99b400640 1 -- 172.21.15.7:0/3343270591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009560 con 0x7fe99c10c3d0 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99aa00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 0x7fe99c19c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99a000640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe99c0744e0 0x7fe99c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe99b400640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 0x7fe99c1a3970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe99400eb10 tx=0x7fe99400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994004b20 con 0x7fe99c10c3d0 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe994004c80 con 0x7fe99c10c3d0 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c1a44c0 con 0x7fe99c10c3d0 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994010690 con 0x7fe99c10c3d0 2024-09-13T18:09:26.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.109+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c1a4990 con 0x7fe99c10c3d0 2024-09-13T18:09:26.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.110+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 45596+0+0 (secure 0 0 0) 0x7fe9940107f0 con 0x7fe99c10c3d0 2024-09-13T18:09:26.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.110+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c1025a0 con 0x7fe99c10c3d0 2024-09-13T18:09:26.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.111+0000 7fe993400640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe980038960 0x7fe98003ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.111+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe994014070 con 0x7fe99c10c3d0 2024-09-13T18:09:26.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.111+0000 7fe99aa00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe980038960 0x7fe98003ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.112+0000 7fe99aa00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe980038960 0x7fe98003ae20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0748c0 tx=0x7fe98c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:26.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.116+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe99401f7b0 con 0x7fe99c10c3d0 2024-09-13T18:09:26.221 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:25.954+0000 7f20869ef040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:09:26.221 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.072+0000 7f20869ef040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:09:26.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.286+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 14) v1 ==== 90706+0+0 (secure 0 0 0) 0x7fe994010cd0 con 0x7fe99c10c3d0 2024-09-13T18:09:26.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:26.315+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe99c02c450 con 0x7fe980038960 2024-09-13T18:09:26.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-mon[35103]: Standby manager daemon z started 2024-09-13T18:09:26.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T18:09:26.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:09:26.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T18:09:26.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:09:26.497 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.218+0000 7f20869ef040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:09:26.498 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.281+0000 7f20869ef040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:09:26.498 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.433+0000 7f20869ef040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:09:26.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:26 smithi007 ceph-mon[30588]: Standby manager daemon z started 2024-09-13T18:09:26.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:26 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T18:09:26.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:26 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:09:26.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:26 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T18:09:26.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:26 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:09:26.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:26 smithi116 ceph-mon[35109]: Standby manager daemon z started 2024-09-13T18:09:26.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:26 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T18:09:26.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:26 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:09:26.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:26 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T18:09:26.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:26 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.116:0/2943731364' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:09:26.794 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.503+0000 7f20869ef040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:09:26.794 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.564+0000 7f20869ef040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:09:26.794 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.725+0000 7f20869ef040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:09:26.794 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.791+0000 7f20869ef040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:09:27.069 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.861+0000 7f20869ef040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:09:27.069 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:26.946+0000 7f20869ef040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:09:27.070 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:27.006+0000 7f20869ef040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:09:27.070 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:27.067+0000 7f20869ef040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:09:27.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T18:09:27.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T18:09:27.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:27.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:09:27.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:09:27.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:27.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:27.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:27.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:27.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:27.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:27.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:27.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:27.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: mgrmap e14: x(active, since 77s), standbys: z 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:27.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:27.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:27.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:28.247 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:09:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y[36475]: 2024-09-13T18:09:27.874+0000 7f20869ef040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:09:28.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:28.298+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mon.2 v2:172.21.15.67:3300/0 8 ==== mgrmap(e 15) v1 ==== 135816+0+0 (secure 0 0 0) 0x7fe99404dc10 con 0x7fe99c10c3d0 2024-09-13T18:09:28.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:28 smithi007 ceph-mon[30588]: Standby manager daemon y started 2024-09-13T18:09:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:28 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T18:09:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:28 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:09:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:28 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T18:09:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:28 smithi007 ceph-mon[30588]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:09:28.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:28 smithi116 ceph-mon[35109]: Standby manager daemon y started 2024-09-13T18:09:28.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:28 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T18:09:28.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:28 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:09:28.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:28 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T18:09:28.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:28 smithi116 ceph-mon[35109]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:09:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:28 smithi067 ceph-mon[35103]: Standby manager daemon y started 2024-09-13T18:09:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:28 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T18:09:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:28 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:09:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:28 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T18:09:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:28 smithi067 ceph-mon[35103]: from='mgr.? 172.21.15.67:0/4260817227' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:09:29.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:29 smithi007 ceph-mon[30588]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T18:09:29.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T18:09:29.645 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:29 smithi007 ceph-mon[30588]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:29.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:29 smithi116 ceph-mon[35109]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T18:09:29.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T18:09:29.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:29 smithi116 ceph-mon[35109]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:29.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:29 smithi067 ceph-mon[35103]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-09-13T18:09:29.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T18:09:29.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:29 smithi067 ceph-mon[35103]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:30.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:30 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/418945321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af9e0446-69fd-4727-87e3-8843be69e76e"}]: dispatch 2024-09-13T18:09:30.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:30 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/418945321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af9e0446-69fd-4727-87e3-8843be69e76e"}]': finished 2024-09-13T18:09:30.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:30 smithi116 ceph-mon[35109]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T18:09:30.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:30 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:30.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:30 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3022654190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:09:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:30 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/418945321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af9e0446-69fd-4727-87e3-8843be69e76e"}]: dispatch 2024-09-13T18:09:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:30 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/418945321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af9e0446-69fd-4727-87e3-8843be69e76e"}]': finished 2024-09-13T18:09:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:30 smithi067 ceph-mon[35103]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T18:09:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:30 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:30 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3022654190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:09:30.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:30 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/418945321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af9e0446-69fd-4727-87e3-8843be69e76e"}]: dispatch 2024-09-13T18:09:30.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:30 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/418945321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af9e0446-69fd-4727-87e3-8843be69e76e"}]': finished 2024-09-13T18:09:30.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:30 smithi007 ceph-mon[30588]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T18:09:30.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:30 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:30.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:30 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3022654190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:09:31.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:31 smithi116 ceph-mon[35109]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:31.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:31 smithi067 ceph-mon[35103]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:31.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:31 smithi007 ceph-mon[30588]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:33.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:33 smithi067 ceph-mon[35103]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:33.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:33 smithi007 ceph-mon[30588]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:33.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:33 smithi116 ceph-mon[35109]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:35.752 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:35 smithi007 ceph-mon[30588]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:35.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:35 smithi116 ceph-mon[35109]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:35 smithi067 ceph-mon[35103]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:37.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:37 smithi007 ceph-mon[30588]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:37.650 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T18:09:37.650 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:37.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:37 smithi116 ceph-mon[35109]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:37.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T18:09:37.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:37 smithi067 ceph-mon[35103]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T18:09:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:38.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:38 smithi007 ceph-mon[30588]: Deploying daemon osd.0 on smithi007 2024-09-13T18:09:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:38 smithi116 ceph-mon[35109]: Deploying daemon osd.0 on smithi007 2024-09-13T18:09:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:38 smithi067 ceph-mon[35103]: Deploying daemon osd.0 on smithi007 2024-09-13T18:09:39.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:39 smithi007 ceph-mon[30588]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:39.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:39 smithi116 ceph-mon[35109]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:39 smithi067 ceph-mon[35103]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:40.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:40 smithi007 ceph-mon[30588]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:40.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:40 smithi116 ceph-mon[35109]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:40 smithi067 ceph-mon[35103]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:43 smithi007 ceph-mon[30588]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:43.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:43 smithi116 ceph-mon[35109]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:43.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:43.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:43.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:43 smithi067 ceph-mon[35103]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:45.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:45 smithi007 ceph-mon[30588]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:45.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:45 smithi116 ceph-mon[35109]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:45.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:45 smithi067 ceph-mon[35103]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:46.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.936+0000 7fe993400640 1 -- 172.21.15.7:0/3343270591 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe99c02c450 con 0x7fe980038960 2024-09-13T18:09:46.940 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe980038960 msgr2=0x7fe98003ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe980038960 0x7fe98003ae20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0748c0 tx=0x7fe98c005f90 comp rx=0 tx=0).stop 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 msgr2=0x7fe99c1a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 0x7fe99c1a3970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe99400eb10 tx=0x7fe99400c2d0 comp rx=0 tx=0).stop 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 shutdown_connections 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe980038960 0x7fe98003ae20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe99c10c3d0 0x7fe99c1a3970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:46.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe99c0744e0 0x7fe99c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 --2- 172.21.15.7:0/3343270591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe99c072f10 0x7fe99c19c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 >> 172.21.15.7:0/3343270591 conn(0x7fe99c0fb5a0 msgr2=0x7fe99c0ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 shutdown_connections 2024-09-13T18:09:46.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:09:46.939+0000 7fe9a1c00640 1 -- 172.21.15.7:0/3343270591 wait complete. 2024-09-13T18:09:47.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:47.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:47.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.238 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:47.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:47.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:47.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:47.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:47.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:47.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:47.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:47.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:47.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:09:47.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:47.623 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T18:09:47.627 INFO:tasks.cephadm:Deploying osd.1 on smithi067 with /dev/vg_nvme/lv_4... 2024-09-13T18:09:47.627 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T18:09:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:09:48.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:48 smithi007 ceph-mon[30588]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T18:09:48.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:48 smithi067 ceph-mon[35103]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T18:09:48.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:48 smithi116 ceph-mon[35109]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T18:09:49.125 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:49 smithi067 ceph-mon[35103]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T18:09:49.126 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:49 smithi067 ceph-mon[35103]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T18:09:49.126 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:49.126 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:49 smithi067 ceph-mon[35103]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:09:49.126 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:49 smithi067 ceph-mon[35103]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:49.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:49 smithi007 ceph-mon[30588]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T18:09:49.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:49 smithi007 ceph-mon[30588]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T18:09:49.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:49.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:49 smithi007 ceph-mon[30588]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:09:49.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:49 smithi007 ceph-mon[30588]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:49.230 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:09:49 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0[45179]: 2024-09-13T18:09:49.039+0000 7f677ee00640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:09:49.230 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:09:49 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0[45179]: 2024-09-13T18:09:49.042+0000 7f677a800640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:09:49.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:49 smithi116 ceph-mon[35109]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T18:09:49.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:49 smithi116 ceph-mon[35109]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T18:09:49.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:49.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:49 smithi116 ceph-mon[35109]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:09:49.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:49 smithi116 ceph-mon[35109]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:49.493 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T18:09:49.600 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T18:09:49.616 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2024-09-13T18:09:49.616 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2024-09-13T18:09:49.616 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132926 s, 789 MB/s 2024-09-13T18:09:49.616 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2024-09-13T18:09:50.227 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_4 2024-09-13T18:09:50.236 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:50 smithi067 ceph-mon[35103]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:09:50.237 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:50 smithi067 ceph-mon[35103]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T18:09:50.237 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:50.237 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:50.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:50 smithi007 ceph-mon[30588]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:09:50.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:50 smithi007 ceph-mon[30588]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T18:09:50.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:50.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:50.426 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:09:50.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:50 smithi116 ceph-mon[35109]: from='osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:09:50.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:50 smithi116 ceph-mon[35109]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T18:09:50.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:50.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] boot 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:09:51.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:51.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:51.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.327 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] boot 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:51.328 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:09:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:09:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: osd.0 [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] boot 2024-09-13T18:09:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T18:09:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:09:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:09:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:09:51.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:51.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:09:51.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:09:51.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 -- 172.21.15.67:0/3375190261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 msgr2=0x7f02c81001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:51.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 --2- 172.21.15.67:0/3375190261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c81001e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009900 tx=0x7f02b802a410 comp rx=0 tx=0).stop 2024-09-13T18:09:51.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 -- 172.21.15.67:0/3375190261 shutdown_connections 2024-09-13T18:09:51.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 --2- 172.21.15.67:0/3375190261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c81019a0 0x7f02c8108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 --2- 172.21.15.67:0/3375190261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02c8100fe0 0x7f02c8101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 --2- 172.21.15.67:0/3375190261 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c81001e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 -- 172.21.15.67:0/3375190261 >> 172.21.15.67:0/3375190261 conn(0x7f02c80fb590 msgr2=0x7f02c80fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 -- 172.21.15.67:0/3375190261 shutdown_connections 2024-09-13T18:09:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.935+0000 7f02cd513640 1 -- 172.21.15.67:0/3375190261 wait complete. 2024-09-13T18:09:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 Processor -- start 2024-09-13T18:09:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 -- start start 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c8195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c8100fe0 0x7f02c8196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02c81019a0 0x7f02c819d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c819d930 con 0x7f02c8100fe0 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c819daa0 con 0x7f02c80ffde0 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02cd513640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c819dc60 con 0x7f02c81019a0 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02c6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c8195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02c6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c8195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33480/0 (socket says 172.21.15.67:33480) 2024-09-13T18:09:51.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02c6ffd640 1 -- 172.21.15.67:0/688880000 learned_addr learned my addr 172.21.15.67:0/688880000 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.936+0000 7f02c67fc640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c8100fe0 0x7f02c8196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c77fe640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02c81019a0 0x7f02c819d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c6ffd640 1 -- 172.21.15.67:0/688880000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02c81019a0 msgr2=0x7f02c819d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c6ffd640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02c81019a0 0x7f02c819d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c6ffd640 1 -- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c8100fe0 msgr2=0x7f02c8196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c6ffd640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c8100fe0 0x7f02c8196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c6ffd640 1 -- 172.21.15.67:0/688880000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8009560 con 0x7f02c80ffde0 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c67fc640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c8100fe0 0x7f02c8196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:51.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02c6ffd640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c8195e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f02b80057c0 tx=0x7f02b8004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:51.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02affff640 1 -- 172.21.15.67:0/688880000 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8004d40 con 0x7f02c80ffde0 2024-09-13T18:09:51.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c819dee0 con 0x7f02c80ffde0 2024-09-13T18:09:51.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02affff640 1 -- 172.21.15.67:0/688880000 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02b8003ab0 con 0x7f02c80ffde0 2024-09-13T18:09:51.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02affff640 1 -- 172.21.15.67:0/688880000 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8031c90 con 0x7f02c80ffde0 2024-09-13T18:09:51.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.937+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c819e320 con 0x7f02c80ffde0 2024-09-13T18:09:51.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.938+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c81073c0 con 0x7f02c80ffde0 2024-09-13T18:09:51.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.939+0000 7f02affff640 1 -- 172.21.15.67:0/688880000 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) v1 ==== 135816+0+0 (secure 0 0 0) 0x7f02b8003c20 con 0x7f02c80ffde0 2024-09-13T18:09:51.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.940+0000 7f02affff640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02b00a1020 0x7f02b00a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:51.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.940+0000 7f02affff640 1 -- 172.21.15.67:0/688880000 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f02b80ec600 con 0x7f02c80ffde0 2024-09-13T18:09:51.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.940+0000 7f02c67fc640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02b00a1020 0x7f02b00a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:51.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.941+0000 7f02c67fc640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02b00a1020 0x7f02b00a34e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02c8197350 tx=0x7f02bc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:51.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:51.943+0000 7f02affff640 1 -- 172.21.15.67:0/688880000 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f02b80b7800 con 0x7f02c80ffde0 2024-09-13T18:09:52.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:09:52.123+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f02c802c480 con 0x7f02b00a1020 2024-09-13T18:09:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:52 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi007 2024-09-13T18:09:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:52 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi007 to 17094M 2024-09-13T18:09:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:52 smithi067 ceph-mon[35103]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T18:09:52.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:52 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi007 2024-09-13T18:09:52.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:52 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi007 to 17094M 2024-09-13T18:09:52.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:52 smithi116 ceph-mon[35109]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T18:09:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:52 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi007 2024-09-13T18:09:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:52 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi007 to 17094M 2024-09-13T18:09:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:52 smithi007 ceph-mon[30588]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T18:09:53.361 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:53 smithi067 ceph-mon[35103]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:53.361 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:09:53.361 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:09:53.361 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:53.361 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:53 smithi067 ceph-mon[35103]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:53.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:53 smithi116 ceph-mon[35109]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:53.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:09:53.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:09:53.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:53.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:53 smithi116 ceph-mon[35109]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:53 smithi007 ceph-mon[30588]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:09:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:09:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:09:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:09:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:53 smithi007 ceph-mon[30588]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:54.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:54 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/2782163802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]: dispatch 2024-09-13T18:09:54.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:54 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]: dispatch 2024-09-13T18:09:54.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:54 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]': finished 2024-09-13T18:09:54.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:54 smithi007 ceph-mon[30588]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T18:09:54.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:54 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:09:54.600 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:54 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/2782163802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]: dispatch 2024-09-13T18:09:54.600 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:54 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]: dispatch 2024-09-13T18:09:54.600 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:54 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]': finished 2024-09-13T18:09:54.600 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:54 smithi067 ceph-mon[35103]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T18:09:54.600 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:54 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:09:54.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:54 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/2782163802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]: dispatch 2024-09-13T18:09:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:54 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]: dispatch 2024-09-13T18:09:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:54 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4126006-2c69-4d91-bd88-868de39d0cb4"}]': finished 2024-09-13T18:09:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:54 smithi116 ceph-mon[35109]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T18:09:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:54 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:09:55.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:55 smithi116 ceph-mon[35109]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:55.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:55 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/1520864515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:09:55.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:55 smithi067 ceph-mon[35103]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:55.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:55 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/1520864515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:09:55.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:55 smithi007 ceph-mon[30588]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:55 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/1520864515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:09:57.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:57 smithi007 ceph-mon[30588]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:57.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:57 smithi116 ceph-mon[35109]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:57.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:57 smithi067 ceph-mon[35103]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:59.675 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:09:59 smithi067 ceph-mon[35103]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:59.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:09:59 smithi007 ceph-mon[30588]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:09:59.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:09:59 smithi116 ceph-mon[35109]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:00.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:00 smithi067 ceph-mon[35103]: overall HEALTH_OK 2024-09-13T18:10:00.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:00 smithi007 ceph-mon[30588]: overall HEALTH_OK 2024-09-13T18:10:00.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:00 smithi116 ceph-mon[35109]: overall HEALTH_OK 2024-09-13T18:10:01.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:01 smithi067 ceph-mon[35103]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:01.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T18:10:01.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:01.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:01 smithi007 ceph-mon[30588]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:01.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T18:10:01.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:01.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:01 smithi116 ceph-mon[35109]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:01.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T18:10:01.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:02.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:02 smithi007 ceph-mon[30588]: Deploying daemon osd.1 on smithi067 2024-09-13T18:10:02.794 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:02 smithi067 ceph-mon[35103]: Deploying daemon osd.1 on smithi067 2024-09-13T18:10:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:02 smithi116 ceph-mon[35109]: Deploying daemon osd.1 on smithi067 2024-09-13T18:10:03.682 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:03 smithi067 ceph-mon[35103]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:03.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:03 smithi007 ceph-mon[30588]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:03.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:03 smithi116 ceph-mon[35109]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:04.625 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:04 smithi067 ceph-mon[35103]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:04 smithi007 ceph-mon[30588]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:04 smithi116 ceph-mon[35109]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:05 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:05 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:05 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:06.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:05 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:06.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:05 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:06.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:05 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:06.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:05 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:06.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:05 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:06.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:05 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:07.146 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:06 smithi067 ceph-mon[35103]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:07.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:06 smithi116 ceph-mon[35109]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:07.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:06 smithi007 ceph-mon[30588]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:08.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:08.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:08.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:08.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:08.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:08.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:08 smithi067 ceph-mon[35103]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:08.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.776+0000 7f02affff640 1 -- 172.21.15.67:0/688880000 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f02c802c480 con 0x7f02b00a1020 2024-09-13T18:10:08.779 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 1 on host 'smithi067' 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.778+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02b00a1020 msgr2=0x7f02b00a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.778+0000 7f02cd513640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02b00a1020 0x7f02b00a34e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02c8197350 tx=0x7f02bc008040 comp rx=0 tx=0).stop 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.778+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 msgr2=0x7f02c8195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.778+0000 7f02cd513640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c8195e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f02b80057c0 tx=0x7f02b8004740 comp rx=0 tx=0).stop 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 shutdown_connections 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02b00a1020 0x7f02b00a34e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02c81019a0 0x7f02c819d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:08.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02c8100fe0 0x7f02c8196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:08.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 --2- 172.21.15.67:0/688880000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02c80ffde0 0x7f02c8195e30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:08.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 >> 172.21.15.67:0/688880000 conn(0x7f02c80fb590 msgr2=0x7f02c8104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:08.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 shutdown_connections 2024-09-13T18:10:08.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:10:08.779+0000 7f02cd513640 1 -- 172.21.15.67:0/688880000 wait complete. 2024-09-13T18:10:08.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:08 smithi116 ceph-mon[35109]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:08 smithi007 ceph-mon[30588]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:09.418 DEBUG:teuthology.orchestra.run.smithi067:osd.1> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T18:10:09.461 INFO:tasks.cephadm:Deploying osd.2 on smithi116 with /dev/vg_nvme/lv_4... 2024-09-13T18:10:09.461 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T18:10:09.649 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:09.649 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:09.649 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:09.665 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:10:09.785 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:09.786 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:09.786 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:09.918 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:09 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1[39611]: 2024-09-13T18:10:09.653+0000 7f9defad1640 -1 osd.1 0 log_to_monitors true 2024-09-13T18:10:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:10.843 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:10 smithi067 ceph-mon[35103]: from='osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:10:10.844 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:10 smithi067 ceph-mon[35103]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:10:10.844 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:10 smithi067 ceph-mon[35103]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:10.895 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:10 smithi116 ceph-mon[35109]: from='osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:10:10.895 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:10 smithi116 ceph-mon[35109]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:10:10.895 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:10 smithi116 ceph-mon[35109]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:10 smithi007 ceph-mon[30588]: from='osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:10:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:10 smithi007 ceph-mon[30588]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:10:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:10 smithi007 ceph-mon[30588]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:11.345 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T18:10:11.428 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T18:10:11.441 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-09-13T18:10:11.441 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-09-13T18:10:11.441 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114242 s, 918 MB/s 2024-09-13T18:10:11.442 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-09-13T18:10:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:11 smithi067 ceph-mon[35103]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T18:10:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:11 smithi067 ceph-mon[35103]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T18:10:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:11 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:11 smithi067 ceph-mon[35103]: from='osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:10:11.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:11 smithi067 ceph-mon[35103]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:10:11.748 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1[39611]: 2024-09-13T18:10:11.602+0000 7f9deb22f640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:10:11.748 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1[39611]: 2024-09-13T18:10:11.606+0000 7f9de786a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:10:11.797 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:11 smithi116 ceph-mon[35109]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T18:10:11.797 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:11 smithi116 ceph-mon[35109]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T18:10:11.797 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:11.797 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:11 smithi116 ceph-mon[35109]: from='osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:10:11.797 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:11 smithi116 ceph-mon[35109]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:10:12.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:11 smithi007 ceph-mon[30588]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T18:10:12.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:11 smithi007 ceph-mon[30588]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T18:10:12.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:12.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:11 smithi007 ceph-mon[30588]: from='osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:10:12.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:11 smithi007 ceph-mon[30588]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:10:12.046 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_4 2024-09-13T18:10:12.246 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:10:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:10:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T18:10:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:12.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi067 2024-09-13T18:10:12.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:10:12.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-13T18:10:12.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:12.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:12.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:12 smithi116 ceph-mon[35109]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:10:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T18:10:12.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:12.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:12.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi067 2024-09-13T18:10:12.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:10:12.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-13T18:10:12.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:12.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:12.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:12.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:12 smithi067 ceph-mon[35103]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:10:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T18:10:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi067 2024-09-13T18:10:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:13.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:10:13.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-13T18:10:13.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:13.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:13.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:13.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:13.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:12 smithi007 ceph-mon[30588]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:10:13.629 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:13 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:10:13.629 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:13 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:10:13.629 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:13 smithi116 ceph-mon[35109]: osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] boot 2024-09-13T18:10:13.629 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:13 smithi116 ceph-mon[35109]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T18:10:13.630 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 -- 172.21.15.116:0/2340985206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fed00 msgr2=0x7fd4b40ff100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 --2- 172.21.15.116:0/2340985206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fed00 0x7fd4b40ff100 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009900 tx=0x7fd4b002a410 comp rx=0 tx=0).stop 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 -- 172.21.15.116:0/2340985206 shutdown_connections 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 --2- 172.21.15.116:0/2340985206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4b41008c0 0x7fd4b4107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 --2- 172.21.15.116:0/2340985206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b40fff00 0x7fd4b4100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 --2- 172.21.15.116:0/2340985206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fed00 0x7fd4b40ff100 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 -- 172.21.15.116:0/2340985206 >> 172.21.15.116:0/2340985206 conn(0x7fd4b40fa490 msgr2=0x7fd4b40fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 -- 172.21.15.116:0/2340985206 shutdown_connections 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.829+0000 7fd4bac69640 1 -- 172.21.15.116:0/2340985206 wait complete. 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 Processor -- start 2024-09-13T18:10:13.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 -- start start 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4b40fed00 0x7fd4b4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fff00 0x7fd4b419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b41008c0 0x7fd4b419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b419d9a0 con 0x7fd4b40fed00 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b419db10 con 0x7fd4b41008c0 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4bac69640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b419dcd0 con 0x7fd4b40fff00 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fff00 0x7fd4b419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fff00 0x7fd4b419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36100/0 (socket says 172.21.15.116:36100) 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 -- 172.21.15.116:0/3219843350 learned_addr learned my addr 172.21.15.116:0/3219843350 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4b8a05640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4b40fed00 0x7fd4b4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 -- 172.21.15.116:0/3219843350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b41008c0 msgr2=0x7fd4b419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b41008c0 0x7fd4b419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 -- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4b40fed00 msgr2=0x7fd4b4069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4b40fed00 0x7fd4b4069280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.830+0000 7fd4abfff640 1 -- 172.21.15.116:0/3219843350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b0009560 con 0x7fd4b40fff00 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.831+0000 7fd4b8a05640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4b40fed00 0x7fd4b4069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.831+0000 7fd4abfff640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fff00 0x7fd4b419aba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400d770 tx=0x7fd4a400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.831+0000 7fd4a9ffb640 1 -- 172.21.15.116:0/3219843350 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4009c30 con 0x7fd4b40fff00 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.831+0000 7fd4a9ffb640 1 -- 172.21.15.116:0/3219843350 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4a400de80 con 0x7fd4b40fff00 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.831+0000 7fd4a9ffb640 1 -- 172.21.15.116:0/3219843350 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4004e40 con 0x7fd4b40fff00 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.831+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b419df50 con 0x7fd4b40fff00 2024-09-13T18:10:13.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.831+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b419e3f0 con 0x7fd4b40fff00 2024-09-13T18:10:13.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.832+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b41061a0 con 0x7fd4b40fff00 2024-09-13T18:10:13.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.833+0000 7fd4a9ffb640 1 -- 172.21.15.116:0/3219843350 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 15) v1 ==== 135816+0+0 (secure 0 0 0) 0x7fd4a4005020 con 0x7fd4b40fff00 2024-09-13T18:10:13.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.834+0000 7fd4a9ffb640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd49c0a1070 0x7fd49c0a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.834+0000 7fd4a9ffb640 1 -- 172.21.15.116:0/3219843350 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fd4a40cab60 con 0x7fd4b40fff00 2024-09-13T18:10:13.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.834+0000 7fd4b8a05640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd49c0a1070 0x7fd49c0a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.835+0000 7fd4b8a05640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd49c0a1070 0x7fd49c0a3530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009230 tx=0x7fd4b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:13.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:13.838+0000 7fd4a9ffb640 1 -- 172.21.15.116:0/3219843350 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd4a4095b40 con 0x7fd4b40fff00 2024-09-13T18:10:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:13 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:10:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:13 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:10:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:13 smithi067 ceph-mon[35103]: osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] boot 2024-09-13T18:10:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:13 smithi067 ceph-mon[35103]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T18:10:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:14.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:14.008+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4b402c480 con 0x7fd49c0a1070 2024-09-13T18:10:14.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:13 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:10:14.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:13 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:10:14.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:13 smithi007 ceph-mon[30588]: osd.1 [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] boot 2024-09-13T18:10:14.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:13 smithi007 ceph-mon[30588]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T18:10:14.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:10:14.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:14 smithi116 ceph-mon[35109]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T18:10:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:14 smithi116 ceph-mon[35109]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:10:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:10:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:10:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:14 smithi116 ceph-mon[35109]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:14 smithi067 ceph-mon[35103]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T18:10:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:14 smithi067 ceph-mon[35103]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:10:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:10:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:10:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:14 smithi067 ceph-mon[35103]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:14 smithi007 ceph-mon[30588]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T18:10:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:14 smithi007 ceph-mon[30588]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:10:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:10:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:10:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:14 smithi007 ceph-mon[30588]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:16.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:16 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/1185670424' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]: dispatch 2024-09-13T18:10:16.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:16 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]: dispatch 2024-09-13T18:10:16.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:16 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]': finished 2024-09-13T18:10:16.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:16 smithi116 ceph-mon[35109]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T18:10:16.472 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:16 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:16 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/1185670424' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]: dispatch 2024-09-13T18:10:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:16 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]: dispatch 2024-09-13T18:10:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:16 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]': finished 2024-09-13T18:10:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:16 smithi067 ceph-mon[35103]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T18:10:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:16 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:16 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/1185670424' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]: dispatch 2024-09-13T18:10:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:16 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]: dispatch 2024-09-13T18:10:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:16 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53b66ec9-242b-4ec9-80b5-6abf872a748f"}]': finished 2024-09-13T18:10:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:16 smithi007 ceph-mon[30588]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T18:10:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:16 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:17 smithi067 ceph-mon[35103]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:17 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/2007883768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:10:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:17 smithi007 ceph-mon[30588]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:17 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/2007883768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:10:17.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:17 smithi116 ceph-mon[35109]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:17.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:17 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/2007883768' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:10:19.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:19 smithi007 ceph-mon[30588]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:19.892 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:19 smithi116 ceph-mon[35109]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:19 smithi067 ceph-mon[35103]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:21 smithi007 ceph-mon[30588]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:21.800 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:21 smithi067 ceph-mon[35103]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:21.938 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:21 smithi116 ceph-mon[35109]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:23 smithi007 ceph-mon[30588]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T18:10:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:23.846 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:23 smithi116 ceph-mon[35109]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:23.846 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T18:10:23.846 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:23 smithi067 ceph-mon[35103]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T18:10:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:24.759 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:24 smithi116 ceph-mon[35109]: Deploying daemon osd.2 on smithi116 2024-09-13T18:10:24.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:24 smithi007 ceph-mon[30588]: Deploying daemon osd.2 on smithi116 2024-09-13T18:10:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:24 smithi067 ceph-mon[35103]: Deploying daemon osd.2 on smithi116 2024-09-13T18:10:25.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:25 smithi116 ceph-mon[35109]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:25.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:25 smithi007 ceph-mon[30588]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:25 smithi067 ceph-mon[35103]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:26.618 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:26 smithi116 ceph-mon[35109]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:26 smithi007 ceph-mon[30588]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:26 smithi067 ceph-mon[35103]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:28.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:28.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:28.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:28.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:28.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:28.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:29.455 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:29 smithi116 ceph-mon[35109]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:29.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:29 smithi067 ceph-mon[35103]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:29.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:29 smithi007 ceph-mon[30588]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:31.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.439+0000 7fd4a9ffb640 1 -- 172.21.15.116:0/3219843350 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd4b402c480 con 0x7fd49c0a1070 2024-09-13T18:10:31.442 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 2 on host 'smithi116' 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd49c0a1070 msgr2=0x7fd49c0a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd49c0a1070 0x7fd49c0a3530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009230 tx=0x7fd4b0000bc0 comp rx=0 tx=0).stop 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fff00 msgr2=0x7fd4b419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fff00 0x7fd4b419aba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400d770 tx=0x7fd4a400dc30 comp rx=0 tx=0).stop 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 shutdown_connections 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd49c0a1070 0x7fd49c0a3530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4b41008c0 0x7fd4b419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:31.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4b40fff00 0x7fd4b419aba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:31.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 --2- 172.21.15.116:0/3219843350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4b40fed00 0x7fd4b4069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:31.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 >> 172.21.15.116:0/3219843350 conn(0x7fd4b40fa490 msgr2=0x7fd4b4103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:31.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.441+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 shutdown_connections 2024-09-13T18:10:31.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:10:31.442+0000 7fd4bac69640 1 -- 172.21.15.116:0/3219843350 wait complete. 2024-09-13T18:10:31.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:31.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:31.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:31.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:32.056 DEBUG:teuthology.orchestra.run.smithi116:osd.2> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T18:10:32.059 INFO:tasks.cephadm:Deploying osd.3 on smithi007 with /dev/vg_nvme/lv_3... 2024-09-13T18:10:32.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T18:10:32.381 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:10:32.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:32 smithi116 ceph-mon[35109]: from='osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:10:32.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:32 smithi116 ceph-mon[35109]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:10:32.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:32 smithi007 ceph-mon[30588]: from='osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:10:32.759 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:32 smithi007 ceph-mon[30588]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:10:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:32 smithi067 ceph-mon[35103]: from='osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:10:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:32 smithi067 ceph-mon[35103]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:10:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-mon[35109]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-mon[35109]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T18:10:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-mon[35109]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T18:10:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-mon[35109]: from='osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:10:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-mon[35109]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:10:33.711 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2[40155]: 2024-09-13T18:10:33.521+0000 7fa5527e2640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:10:33.712 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2[40155]: 2024-09-13T18:10:33.525+0000 7fa54ee1d640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:10:33.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:33 smithi007 ceph-mon[30588]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:33.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:33 smithi007 ceph-mon[30588]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T18:10:33.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:33 smithi007 ceph-mon[30588]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T18:10:33.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:33.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:33 smithi007 ceph-mon[30588]: from='osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:10:33.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:33 smithi007 ceph-mon[30588]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:10:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:33 smithi067 ceph-mon[35103]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:33 smithi067 ceph-mon[35103]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T18:10:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:33 smithi067 ceph-mon[35103]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T18:10:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:33 smithi067 ceph-mon[35103]: from='osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:10:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:33 smithi067 ceph-mon[35103]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:10:34.662 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T18:10:34.665 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:34 smithi116 ceph-mon[35109]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:10:34.665 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:34 smithi116 ceph-mon[35109]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T18:10:34.665 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:34.665 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:34.665 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:34 smithi116 ceph-mon[35109]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:34.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:34 smithi007 ceph-mon[30588]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:10:34.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:34 smithi007 ceph-mon[30588]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T18:10:34.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:34.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:34.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:34 smithi007 ceph-mon[30588]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:34.803 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T18:10:34.837 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-09-13T18:10:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-09-13T18:10:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0281096 s, 373 MB/s 2024-09-13T18:10:34.837 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-09-13T18:10:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:34 smithi067 ceph-mon[35103]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:10:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:34 smithi067 ceph-mon[35103]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T18:10:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:34 smithi067 ceph-mon[35103]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:10:35.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-09-13T18:10:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:10:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:10:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] boot 2024-09-13T18:10:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T18:10:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi116 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:35.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] boot 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi116 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:10:35.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-13T18:10:35.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:35.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:35.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: osd.2 [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] boot 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi116 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:36.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:36.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:10:36.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi116 to 17088M 2024-09-13T18:10:36.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:36.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:36.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:36.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:37.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:37 smithi007 ceph-mon[30588]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T18:10:37.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:10:37.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:37 smithi116 ceph-mon[35109]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T18:10:37.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:10:37.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:37 smithi067 ceph-mon[35103]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T18:10:37.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:10:37.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.852+0000 7f3795a00640 1 -- 172.21.15.7:0/1051577975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790072eb0 msgr2=0x7f3790073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.852+0000 7f3795a00640 1 --2- 172.21.15.7:0/1051577975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790072eb0 0x7f3790073310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3778009900 tx=0x7f377802a480 comp rx=0 tx=0).stop 2024-09-13T18:10:37.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.852+0000 7f3795a00640 1 -- 172.21.15.7:0/1051577975 shutdown_connections 2024-09-13T18:10:37.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.852+0000 7f3795a00640 1 --2- 172.21.15.7:0/1051577975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790107ca0 0x7f379010a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.852+0000 7f3795a00640 1 --2- 172.21.15.7:0/1051577975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790072eb0 0x7f3790073310 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.852+0000 7f3795a00640 1 --2- 172.21.15.7:0/1051577975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3790074480 0x7f37900728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.852+0000 7f3795a00640 1 -- 172.21.15.7:0/1051577975 >> 172.21.15.7:0/1051577975 conn(0x7f37900fb5d0 msgr2=0x7f37900fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:37.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.853+0000 7f3795a00640 1 -- 172.21.15.7:0/1051577975 shutdown_connections 2024-09-13T18:10:37.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.853+0000 7f3795a00640 1 -- 172.21.15.7:0/1051577975 wait complete. 2024-09-13T18:10:37.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.853+0000 7f3795a00640 1 Processor -- start 2024-09-13T18:10:37.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3795a00640 1 -- start start 2024-09-13T18:10:37.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3795a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3790072eb0 0x7f3790103140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3795a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790074480 0x7f3790103680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3795a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790107ca0 0x7f37900ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3795a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790100430 con 0x7f3790074480 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3795a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37901005a0 con 0x7f3790072eb0 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3795a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790100760 con 0x7f3790107ca0 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3786000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790074480 0x7f3790103680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f378ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3790072eb0 0x7f3790103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3786000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790074480 0x7f3790103680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42812/0 (socket says 172.21.15.7:42812) 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f3786000640 1 -- 172.21.15.7:0/2007601906 learned_addr learned my addr 172.21.15.7:0/2007601906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.854+0000 7f378f400640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790107ca0 0x7f37900ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f378f400640 1 -- 172.21.15.7:0/2007601906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3790072eb0 msgr2=0x7f3790103140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f378f400640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3790072eb0 0x7f3790103140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f378f400640 1 -- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790074480 msgr2=0x7f3790103680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f378f400640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790074480 0x7f3790103680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f378f400640 1 -- 172.21.15.7:0/2007601906 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009560 con 0x7f3790107ca0 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f3786000640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790074480 0x7f3790103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f378f400640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790107ca0 0x7f37900ffca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f378800e940 tx=0x7f378800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788004d20 con 0x7f3790107ca0 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3788004e80 con 0x7f3790107ca0 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788011470 con 0x7f3790107ca0 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.855+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37901a4480 con 0x7f3790107ca0 2024-09-13T18:10:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.856+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37901a4930 con 0x7f3790107ca0 2024-09-13T18:10:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.857+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3790106a60 con 0x7f3790107ca0 2024-09-13T18:10:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.859+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 15) v1 ==== 135816+0+0 (secure 0 0 0) 0x7f378800cb20 con 0x7f3790107ca0 2024-09-13T18:10:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.860+0000 7f3787e00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f37740a1070 0x7f37740a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.860+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f37880cb4c0 con 0x7f3790107ca0 2024-09-13T18:10:37.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.860+0000 7f378ea00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f37740a1070 0x7f37740a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.861+0000 7f378ea00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f37740a1070 0x7f37740a3530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3780005fd0 tx=0x7f378000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:37.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:37.862+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37880961a0 con 0x7f3790107ca0 2024-09-13T18:10:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:38.054+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f379002c450 con 0x7f37740a1070 2024-09-13T18:10:38.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:38 smithi007 ceph-mon[30588]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:38.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T18:10:38.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:38 smithi007 ceph-mon[30588]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T18:10:38.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:10:38.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:38 smithi116 ceph-mon[35109]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:38.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T18:10:38.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:38 smithi116 ceph-mon[35109]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T18:10:38.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:10:38.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:38 smithi067 ceph-mon[35103]: pgmap v83: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:38.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T18:10:38.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:38 smithi067 ceph-mon[35103]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T18:10:38.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:10:38.884 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:38 smithi007 sudo[49520]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:10:38.885 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:38 smithi007 sudo[49520]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:38.885 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:38 smithi007 sudo[49520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:38.885 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:38 smithi007 sudo[49520]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:39.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:39.092+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f3788096570 con 0x7f3790107ca0 2024-09-13T18:10:39.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:39 smithi007 ceph-mon[30588]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:10:39.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:10:39.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:10:39.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:39.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:10:39.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:39 smithi007 ceph-mon[30588]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T18:10:39.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:39 smithi007 ceph-mon[30588]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:39.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:39 smithi116 ceph-mon[35109]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:10:39.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:10:39.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:10:39.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:39.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:10:39.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:39 smithi116 ceph-mon[35109]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T18:10:39.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:39 smithi116 ceph-mon[35109]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:39.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:39 smithi067 ceph-mon[35103]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:10:39.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:10:39.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:10:39.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:39.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:10:39.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:39 smithi067 ceph-mon[35103]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T18:10:39.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:39 smithi067 ceph-mon[35103]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:39.628 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:39 smithi007 sudo[49542]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:10:39.628 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:39 smithi007 sudo[49542]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:39.628 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:39 smithi007 sudo[49542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:39.629 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:10:39 smithi007 sudo[49542]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:39.894 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43288]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:10:39.895 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43288]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:39.895 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:39.895 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43288]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:40 smithi007 ceph-mon[30588]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T18:10:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:40 smithi007 ceph-mon[30588]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T18:10:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:40 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:40.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:40 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:40.247 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43291]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:10:40.247 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43291]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:40.247 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:40.247 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:10:39 smithi067 sudo[43291]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:40.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:40 smithi067 ceph-mon[35103]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T18:10:40.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:40 smithi067 ceph-mon[35103]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T18:10:40.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:40 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:40.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:40 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:40.418 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:40 smithi116 ceph-mon[35109]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T18:10:40.419 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:40 smithi116 ceph-mon[35109]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T18:10:40.419 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:40 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:40.419 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:40 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:40.419 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44183]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:10:40.419 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44183]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:40.419 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:40.419 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44183]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:40.710 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44186]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:10:40.710 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44186]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:40.710 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:40.711 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:10:40 smithi116 sudo[44186]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:41.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:40 smithi007 sudo[49614]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:10:41.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:40 smithi007 sudo[49614]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:41.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:40 smithi007 sudo[49614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:41.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:41 smithi007 sudo[49614]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:41.837 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:41.837 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:41 smithi116 ceph-mon[35109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:41.837 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:41 smithi116 sudo[44189]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:10:41.837 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:41 smithi116 sudo[44189]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:41.838 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:41 smithi116 sudo[44189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:41.838 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:41 smithi116 sudo[44189]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:41.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:41 smithi007 sudo[49617]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:10:41.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:41 smithi007 sudo[49617]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:41.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:41 smithi007 sudo[49617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:41.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:41 smithi007 sudo[49617]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:41.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:41.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:41 smithi007 ceph-mon[30588]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:41.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:41.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:41 smithi067 ceph-mon[35103]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:42.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 sudo[44192]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:10:42.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 sudo[44192]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:42.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 sudo[44192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:42.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 sudo[44192]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:42.606 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43294]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:10:42.606 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43294]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:42.607 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:42.607 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43294]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1864331747' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]: dispatch 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]: dispatch 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]': finished 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2039823158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:10:42.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:42 smithi116 ceph-mon[35109]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43299]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 sudo[43299]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1864331747' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]: dispatch 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]: dispatch 2024-09-13T18:10:42.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]': finished 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2039823158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:10:42.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:42 smithi067 ceph-mon[35103]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1864331747' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]: dispatch 2024-09-13T18:10:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]: dispatch 2024-09-13T18:10:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de4ca10d-cfea-4ff0-b71d-dca462cca1e2"}]': finished 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2039823158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:10:43.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:42 smithi007 ceph-mon[30588]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:43.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:43 smithi116 ceph-mon[35109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:43.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:43 smithi116 ceph-mon[35109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:43 smithi067 ceph-mon[35103]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:43 smithi067 ceph-mon[35103]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:44.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:43 smithi007 ceph-mon[30588]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:10:44.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:43 smithi007 ceph-mon[30588]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:10:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:44 smithi116 ceph-mon[35109]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 341 KiB/s wr, 22 op/s 2024-09-13T18:10:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:44 smithi067 ceph-mon[35103]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 341 KiB/s wr, 22 op/s 2024-09-13T18:10:45.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:44 smithi007 ceph-mon[30588]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 341 KiB/s wr, 22 op/s 2024-09-13T18:10:47.754 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:47 smithi007 ceph-mon[30588]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 248 KiB/s wr, 16 op/s 2024-09-13T18:10:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:47 smithi116 ceph-mon[35109]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 248 KiB/s wr, 16 op/s 2024-09-13T18:10:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:47 smithi067 ceph-mon[35103]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 248 KiB/s wr, 16 op/s 2024-09-13T18:10:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:49 smithi007 ceph-mon[30588]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 195 KiB/s wr, 13 op/s 2024-09-13T18:10:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T18:10:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:49.878 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:49 smithi116 ceph-mon[35109]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 195 KiB/s wr, 13 op/s 2024-09-13T18:10:49.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T18:10:49.879 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:49 smithi067 ceph-mon[35103]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 195 KiB/s wr, 13 op/s 2024-09-13T18:10:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T18:10:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:50.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:50 smithi007 ceph-mon[30588]: Deploying daemon osd.3 on smithi007 2024-09-13T18:10:50.820 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:50 smithi116 ceph-mon[35109]: Deploying daemon osd.3 on smithi007 2024-09-13T18:10:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:50 smithi067 ceph-mon[35103]: Deploying daemon osd.3 on smithi007 2024-09-13T18:10:51.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:51 smithi007 ceph-mon[30588]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T18:10:51.898 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:51 smithi067 ceph-mon[35103]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T18:10:51.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:51 smithi116 ceph-mon[35109]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T18:10:53.662 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:53 smithi007 ceph-mon[30588]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 168 KiB/s wr, 11 op/s 2024-09-13T18:10:53.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:53 smithi116 ceph-mon[35109]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 168 KiB/s wr, 11 op/s 2024-09-13T18:10:53.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:53 smithi067 ceph-mon[35103]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 168 KiB/s wr, 11 op/s 2024-09-13T18:10:54.757 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:54 smithi007 ceph-mon[30588]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T18:10:54.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:54 smithi116 ceph-mon[35109]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T18:10:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:54 smithi067 ceph-mon[35103]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-09-13T18:10:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:55 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:55 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:55 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:55.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:55 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:55.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:55 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:55.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:55 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:55 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:55 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:55 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:56.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:56 smithi007 ceph-mon[30588]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:56 smithi116 ceph-mon[35109]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:56 smithi067 ceph-mon[35103]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:59.352 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 3 on host 'smithi007' 2024-09-13T18:10:59.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.350+0000 7f3787e00640 1 -- 172.21.15.7:0/2007601906 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f379002c450 con 0x7f37740a1070 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.352+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f37740a1070 msgr2=0x7f37740a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.352+0000 7f3795a00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f37740a1070 0x7f37740a3530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3780005fd0 tx=0x7f378000b390 comp rx=0 tx=0).stop 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.352+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790107ca0 msgr2=0x7f37900ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.352+0000 7f3795a00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790107ca0 0x7f37900ffca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f378800e940 tx=0x7f378800ee00 comp rx=0 tx=0).stop 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 shutdown_connections 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f37740a1070 0x7f37740a3530 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3790107ca0 0x7f37900ffca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3790074480 0x7f3790103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 --2- 172.21.15.7:0/2007601906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3790072eb0 0x7f3790103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:59.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 >> 172.21.15.7:0/2007601906 conn(0x7f37900fb5d0 msgr2=0x7f3790103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 shutdown_connections 2024-09-13T18:10:59.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:10:59.353+0000 7f3795a00640 1 -- 172.21.15.7:0/2007601906 wait complete. 2024-09-13T18:10:59.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:59.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:59.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:59.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:59.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:10:59 smithi007 ceph-mon[30588]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:10:59 smithi067 ceph-mon[35103]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:10:59.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:10:59.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:10:59 smithi116 ceph-mon[35109]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:11:00.066 DEBUG:teuthology.orchestra.run.smithi007:osd.3> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T18:11:00.071 INFO:tasks.cephadm:Deploying osd.4 on smithi067 with /dev/vg_nvme/lv_3... 2024-09-13T18:11:00.071 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T18:11:00.281 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:11:01.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:01 smithi007 ceph-mon[30588]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T18:11:01.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:01 smithi007 ceph-mon[30588]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T18:11:01.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:01.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:01 smithi007 ceph-mon[30588]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:11:01.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:01 smithi007 ceph-mon[30588]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:11:01.628 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:01 smithi067 ceph-mon[35103]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T18:11:01.628 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:01 smithi067 ceph-mon[35103]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T18:11:01.628 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:01.628 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:01 smithi067 ceph-mon[35103]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:11:01.628 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:01 smithi067 ceph-mon[35103]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:11:01.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:01 smithi116 ceph-mon[35109]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T18:11:01.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:01 smithi116 ceph-mon[35109]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T18:11:01.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:01.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:01 smithi116 ceph-mon[35109]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:11:01.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:01 smithi116 ceph-mon[35109]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:11:01.987 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T18:11:02.074 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T18:11:02.088 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2024-09-13T18:11:02.088 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2024-09-13T18:11:02.088 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112798 s, 930 MB/s 2024-09-13T18:11:02.088 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2024-09-13T18:11:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:02 smithi007 ceph-mon[30588]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:11:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:02 smithi007 ceph-mon[30588]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T18:11:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:02.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:02 smithi007 ceph-mon[30588]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' 2024-09-13T18:11:02.542 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:11:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3[51654]: 2024-09-13T18:11:02.202+0000 7f76eac00640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:11:02.542 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:11:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3[51654]: 2024-09-13T18:11:02.223+0000 7f76e1600640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:11:02.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:02 smithi116 ceph-mon[35109]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:11:02.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:02 smithi116 ceph-mon[35109]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T18:11:02.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:02.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:02.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:02 smithi116 ceph-mon[35109]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' 2024-09-13T18:11:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:02 smithi067 ceph-mon[35103]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:11:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:02 smithi067 ceph-mon[35103]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T18:11:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:02 smithi067 ceph-mon[35103]: from='osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084]' entity='osd.3' 2024-09-13T18:11:02.785 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_3 2024-09-13T18:11:02.989 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:11:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:03 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:11:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:03 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:11:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:03 smithi116 ceph-mon[35109]: osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] boot 2024-09-13T18:11:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:03 smithi116 ceph-mon[35109]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T18:11:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:03 smithi116 ceph-mon[35109]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:11:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:03 smithi116 ceph-mon[35109]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T18:11:03.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:03 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:11:03.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:03 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:11:03.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:03 smithi067 ceph-mon[35103]: osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] boot 2024-09-13T18:11:03.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:03 smithi067 ceph-mon[35103]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T18:11:03.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:03.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:03 smithi067 ceph-mon[35103]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:11:03.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:03 smithi067 ceph-mon[35103]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T18:11:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:03 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:11:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:03 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:11:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:03 smithi007 ceph-mon[30588]: osd.3 [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] boot 2024-09-13T18:11:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:03 smithi007 ceph-mon[30588]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T18:11:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:11:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:03 smithi007 ceph-mon[30588]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:11:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:03 smithi007 ceph-mon[30588]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T18:11:04.590 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi007 2024-09-13T18:11:04.590 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.590 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.590 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:04.590 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:04.590 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi007 to 8547M 2024-09-13T18:11:04.591 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.591 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:04.591 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:04.591 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.591 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:04 smithi067 ceph-mon[35103]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T18:11:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 -- 172.21.15.67:0/3056127223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 msgr2=0x7f4abc0ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 --2- 172.21.15.67:0/3056127223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc0ff0e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009900 tx=0x7f4ab002a410 comp rx=0 tx=0).stop 2024-09-13T18:11:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 -- 172.21.15.67:0/3056127223 shutdown_connections 2024-09-13T18:11:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 --2- 172.21.15.67:0/3056127223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4abc1008a0 0x7f4abc107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 --2- 172.21.15.67:0/3056127223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc0ffee0 0x7f4abc100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 --2- 172.21.15.67:0/3056127223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc0ff0e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 -- 172.21.15.67:0/3056127223 >> 172.21.15.67:0/3056127223 conn(0x7f4abc0fa490 msgr2=0x7f4abc0fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:11:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 -- 172.21.15.67:0/3056127223 shutdown_connections 2024-09-13T18:11:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.602+0000 7f4ac3107640 1 -- 172.21.15.67:0/3056127223 wait complete. 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 Processor -- start 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 -- start start 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc102c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc0ffee0 0x7f4abc1012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4abc1008a0 0x7f4abc101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc101f00 con 0x7f4abc0ffee0 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc102070 con 0x7f4abc0fece0 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac3107640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc19ff90 con 0x7f4abc1008a0 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37694/0 (socket says 172.21.15.67:37694) 2024-09-13T18:11:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 -- 172.21.15.67:0/913652614 learned_addr learned my addr 172.21.15.67:0/913652614 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac16a4640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4abc1008a0 0x7f4abc101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 -- 172.21.15.67:0/913652614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4abc1008a0 msgr2=0x7f4abc101800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4abc1008a0 0x7f4abc101800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 -- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc0ffee0 msgr2=0x7f4abc1012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc0ffee0 0x7f4abc1012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 -- 172.21.15.67:0/913652614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab0009560 con 0x7f4abc0fece0 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac16a4640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4abc1008a0 0x7f4abc101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.603+0000 7f4ac0ea3640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc102c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00057c0 tx=0x7f4ab0004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.604+0000 7f4ab9ffb640 1 -- 172.21.15.67:0/913652614 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0004d40 con 0x7f4abc0fece0 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.604+0000 7f4ab9ffb640 1 -- 172.21.15.67:0/913652614 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ab0003ab0 con 0x7f4abc0fece0 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.604+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc1a0190 con 0x7f4abc0fece0 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.604+0000 7f4ab9ffb640 1 -- 172.21.15.67:0/913652614 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0031c90 con 0x7f4abc0fece0 2024-09-13T18:11:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.604+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc1a0700 con 0x7f4abc0fece0 2024-09-13T18:11:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.605+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc10a680 con 0x7f4abc0fece0 2024-09-13T18:11:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.606+0000 7f4ab9ffb640 1 -- 172.21.15.67:0/913652614 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f4ab0003c20 con 0x7f4abc0fece0 2024-09-13T18:11:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.606+0000 7f4ab9ffb640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aac0a1100 0x7f4aac0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:04.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.607+0000 7f4ab9ffb640 1 -- 172.21.15.67:0/913652614 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f4ab00ec880 con 0x7f4abc0fece0 2024-09-13T18:11:04.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.607+0000 7f4abbfff640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aac0a1100 0x7f4aac0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:04.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.607+0000 7f4abbfff640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aac0a1100 0x7f4aac0a35c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4abc1029a0 tx=0x7f4aa8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:11:04.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.611+0000 7f4ab9ffb640 1 -- 172.21.15.67:0/913652614 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ab00b7210 con 0x7f4abc0fece0 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi007 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi007 to 8547M 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:04 smithi116 ceph-mon[35109]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T18:11:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi007 2024-09-13T18:11:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:04.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:04.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi007 to 8547M 2024-09-13T18:11:04.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:04.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:04.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:04.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:04 smithi007 ceph-mon[30588]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T18:11:04.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:04.794+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4abc068640 con 0x7f4aac0a1100 2024-09-13T18:11:05.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:05 smithi116 ceph-mon[35109]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:05.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:05 smithi116 ceph-mon[35109]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T18:11:05.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:05 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:05.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:05 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:05.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:05 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:05.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:05 smithi067 ceph-mon[35103]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:05.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:05 smithi067 ceph-mon[35103]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T18:11:05.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:05 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:05.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:05 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:05.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:05 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:05.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:05 smithi007 ceph-mon[30588]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:05.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:05 smithi007 ceph-mon[30588]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T18:11:05.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:05 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:05.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:05 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:05.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:05 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:06.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:06 smithi067 ceph-mon[35103]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:06.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:06 smithi067 ceph-mon[35103]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T18:11:06.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:06 smithi116 ceph-mon[35109]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:06.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:06 smithi116 ceph-mon[35109]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T18:11:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:06 smithi007 ceph-mon[30588]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:06 smithi007 ceph-mon[30588]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T18:11:07.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:07 smithi067 ceph-mon[35103]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:07.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/2937528057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]: dispatch 2024-09-13T18:11:07.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:07 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]: dispatch 2024-09-13T18:11:07.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:07 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]': finished 2024-09-13T18:11:07.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:07 smithi067 ceph-mon[35103]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T18:11:07.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:07 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:07.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:07 smithi116 ceph-mon[35109]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:07.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/2937528057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]: dispatch 2024-09-13T18:11:07.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:07 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]: dispatch 2024-09-13T18:11:07.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:07 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]': finished 2024-09-13T18:11:07.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:07 smithi116 ceph-mon[35109]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T18:11:07.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:07 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:07 smithi007 ceph-mon[30588]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/2937528057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]: dispatch 2024-09-13T18:11:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:07 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]: dispatch 2024-09-13T18:11:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:07 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9537f823-5479-4ebc-8d59-2b4680603d49"}]': finished 2024-09-13T18:11:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:07 smithi007 ceph-mon[30588]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T18:11:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:07 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:08.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:08 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/1324833037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:08.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:08 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/1324833037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:08 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/1324833037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:09.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:09 smithi116 ceph-mon[35109]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:09.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:09 smithi067 ceph-mon[35103]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:09.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:09 smithi007 ceph-mon[30588]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:11.739 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:11 smithi067 ceph-mon[35103]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:11:11.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:11 smithi007 ceph-mon[30588]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:11:11.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:11 smithi116 ceph-mon[35109]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:11:13.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:13 smithi067 ceph-mon[35103]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T18:11:13.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:13 smithi007 ceph-mon[30588]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T18:11:13.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:13 smithi116 ceph-mon[35109]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T18:11:14.664 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T18:11:14.664 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:14.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T18:11:14.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:14.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T18:11:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:15.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:15 smithi067 ceph-mon[35103]: Deploying daemon osd.4 on smithi067 2024-09-13T18:11:15.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:15 smithi067 ceph-mon[35103]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T18:11:15.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:15 smithi007 ceph-mon[30588]: Deploying daemon osd.4 on smithi067 2024-09-13T18:11:15.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:15 smithi007 ceph-mon[30588]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T18:11:15.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:15 smithi116 ceph-mon[35109]: Deploying daemon osd.4 on smithi067 2024-09-13T18:11:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:15 smithi116 ceph-mon[35109]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T18:11:16.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:16 smithi007 ceph-mon[30588]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:11:16.846 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:16 smithi067 ceph-mon[35103]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:11:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:16 smithi116 ceph-mon[35109]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:11:18.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:18.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:18.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:18.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:18.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:18.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:19.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:19 smithi116 ceph-mon[35109]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-13T18:11:19.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:19 smithi067 ceph-mon[35103]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-13T18:11:19.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:19 smithi007 ceph-mon[30588]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-13T18:11:21.096 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 4 on host 'smithi067' 2024-09-13T18:11:21.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.093+0000 7f4ab9ffb640 1 -- 172.21.15.67:0/913652614 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4abc068640 con 0x7f4aac0a1100 2024-09-13T18:11:21.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aac0a1100 msgr2=0x7f4aac0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:21.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aac0a1100 0x7f4aac0a35c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4abc1029a0 tx=0x7f4aa8006c90 comp rx=0 tx=0).stop 2024-09-13T18:11:21.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 msgr2=0x7f4abc102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:21.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc102c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00057c0 tx=0x7f4ab0004740 comp rx=0 tx=0).stop 2024-09-13T18:11:21.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 shutdown_connections 2024-09-13T18:11:21.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aac0a1100 0x7f4aac0a35c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:21.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4abc1008a0 0x7f4abc101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:21.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4abc0ffee0 0x7f4abc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:21.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 --2- 172.21.15.67:0/913652614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4abc0fece0 0x7f4abc102c20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:21.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.095+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 >> 172.21.15.67:0/913652614 conn(0x7f4abc0fa490 msgr2=0x7f4abc067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:11:21.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.096+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 shutdown_connections 2024-09-13T18:11:21.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:11:21.096+0000 7f4ac3107640 1 -- 172.21.15.67:0/913652614 wait complete. 2024-09-13T18:11:21.684 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:21 smithi067 ceph-mon[35103]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:11:21.684 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:21.684 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:21 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:21.704 DEBUG:teuthology.orchestra.run.smithi067:osd.4> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T18:11:21.707 INFO:tasks.cephadm:Deploying osd.5 on smithi116 with /dev/vg_nvme/lv_3... 2024-09-13T18:11:21.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T18:11:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:21 smithi007 ceph-mon[30588]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:11:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:21 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:21.911 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:11:21.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:21 smithi116 ceph-mon[35109]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:11:21.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:21.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:21 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:22.497 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:11:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:11:22.247+0000 7f0f2bc7f640 -1 osd.4 0 log_to_monitors true 2024-09-13T18:11:23.131 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:22 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:23.131 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:22 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:23.131 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:22 smithi116 ceph-mon[35109]: from='osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:11:23.131 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:22 smithi116 ceph-mon[35109]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:11:23.131 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:22 smithi116 ceph-mon[35109]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:23.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:22 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:23.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:22 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:23.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:22 smithi067 ceph-mon[35103]: from='osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:11:23.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:22 smithi067 ceph-mon[35103]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:11:23.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:22 smithi067 ceph-mon[35103]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:23.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:23.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:23.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:22 smithi007 ceph-mon[30588]: from='osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:11:23.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:22 smithi007 ceph-mon[30588]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:11:23.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:22 smithi007 ceph-mon[30588]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:23.603 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T18:11:23.709 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T18:11:23.724 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-09-13T18:11:23.724 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-09-13T18:11:23.724 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0130095 s, 806 MB/s 2024-09-13T18:11:23.724 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-09-13T18:11:23.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:23 smithi116 ceph-mon[35109]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T18:11:23.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:23 smithi116 ceph-mon[35109]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T18:11:23.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:23 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:23.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:23 smithi116 ceph-mon[35109]: from='osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:11:23.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:23 smithi116 ceph-mon[35109]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:11:24.130 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:23 smithi067 ceph-mon[35103]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T18:11:24.130 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:23 smithi067 ceph-mon[35103]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T18:11:24.131 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:23 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:24.131 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:23 smithi067 ceph-mon[35103]: from='osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:11:24.131 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:23 smithi067 ceph-mon[35103]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:11:24.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:23 smithi007 ceph-mon[30588]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T18:11:24.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:23 smithi007 ceph-mon[30588]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T18:11:24.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:23 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:24.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:23 smithi007 ceph-mon[30588]: from='osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:11:24.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:23 smithi007 ceph-mon[30588]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:11:24.355 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_3 2024-09-13T18:11:24.560 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:11:24.724 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:11:24.712+0000 7f0f273dd640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:11:24.997 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:11:24.724+0000 7f0f1fa10640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:11:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:11:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T18:11:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='osd.4 ' entity='osd.4' 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:24.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:24 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:11:25.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T18:11:25.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:25.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='osd.4 ' entity='osd.4' 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:25.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:24 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='osd.4 ' entity='osd.4' 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:25.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:24 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:26.016 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:11:26.016 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:11:26.016 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi067 2024-09-13T18:11:26.016 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] boot 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T18:11:26.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 -- 172.21.15.116:0/1846628272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c101920 msgr2=0x7fe71c108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:26.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 --2- 172.21.15.116:0/1846628272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c101920 0x7fe71c108240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe714009ca0 tx=0x7fe71402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 -- 172.21.15.116:0/1846628272 shutdown_connections 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 --2- 172.21.15.116:0/1846628272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c101920 0x7fe71c108240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 --2- 172.21.15.116:0/1846628272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe71c100f60 0x7fe71c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 --2- 172.21.15.116:0/1846628272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe71c0ffe00 0x7fe71c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 -- 172.21.15.116:0/1846628272 >> 172.21.15.116:0/1846628272 conn(0x7fe71c0fb590 msgr2=0x7fe71c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 -- 172.21.15.116:0/1846628272 shutdown_connections 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.223+0000 7fe72449d640 1 -- 172.21.15.116:0/1846628272 wait complete. 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 Processor -- start 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 -- start start 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe71c0ffe00 0x7fe71c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c100f60 0x7fe71c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:26.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe71c101920 0x7fe71c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c073570 con 0x7fe71c0ffe00 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0736e0 con 0x7fe71c101920 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe72449d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c19fcb0 con 0x7fe71c100f60 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c100f60 0x7fe71c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c100f60 0x7fe71c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43088/0 (socket says 172.21.15.116:43088) 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 -- 172.21.15.116:0/4043634915 learned_addr learned my addr 172.21.15.116:0/4043634915 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe722a3a640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe71c101920 0x7fe71c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 -- 172.21.15.116:0/4043634915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe71c101920 msgr2=0x7fe71c072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe71c101920 0x7fe71c072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 -- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe71c0ffe00 msgr2=0x7fe71c074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe71c0ffe00 0x7fe71c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.224+0000 7fe721a38640 1 -- 172.21.15.116:0/4043634915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714009900 con 0x7fe71c100f60 2024-09-13T18:11:26.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.225+0000 7fe721a38640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c100f60 0x7fe71c0728a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c9a0 tx=0x7fe70c00ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:11:26.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.225+0000 7fe7137fe640 1 -- 172.21.15.116:0/4043634915 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c007c10 con 0x7fe71c100f60 2024-09-13T18:11:26.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.225+0000 7fe7137fe640 1 -- 172.21.15.116:0/4043634915 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70c007d70 con 0x7fe71c100f60 2024-09-13T18:11:26.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.225+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c19ff60 con 0x7fe71c100f60 2024-09-13T18:11:26.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.225+0000 7fe7137fe640 1 -- 172.21.15.116:0/4043634915 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c00f7d0 con 0x7fe71c100f60 2024-09-13T18:11:26.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.225+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c1a03d0 con 0x7fe71c100f60 2024-09-13T18:11:26.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.226+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c107120 con 0x7fe71c100f60 2024-09-13T18:11:26.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.227+0000 7fe7137fe640 1 -- 172.21.15.116:0/4043634915 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fe70c018480 con 0x7fe71c100f60 2024-09-13T18:11:26.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.227+0000 7fe7137fe640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7080a1080 0x7fe7080a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:26.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.228+0000 7fe7137fe640 1 -- 172.21.15.116:0/4043634915 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fe70c013070 con 0x7fe71c100f60 2024-09-13T18:11:26.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.228+0000 7fe722239640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7080a1080 0x7fe7080a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:26.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.228+0000 7fe722239640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7080a1080 0x7fe7080a3540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe71800a990 tx=0x7fe718005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:11:26.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.232+0000 7fe7137fe640 1 -- 172.21.15.116:0/4043634915 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe70c096510 con 0x7fe71c100f60 2024-09-13T18:11:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:11:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:11:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi067 2024-09-13T18:11:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-13T18:11:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:26.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:26.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:26.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:26.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] boot 2024-09-13T18:11:26.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T18:11:26.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi067 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: osd.4 [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] boot 2024-09-13T18:11:26.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T18:11:26.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:11:26.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:26.401+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe71c02c590 con 0x7fe7080a1080 2024-09-13T18:11:27.071 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:26 smithi116 ceph-mon[35109]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:27.071 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:26 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:27.071 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:26 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:27.071 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:26 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:27.072 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:26 smithi116 ceph-mon[35109]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:27.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:26 smithi067 ceph-mon[35103]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:27.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:26 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:27.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:26 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:27.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:26 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:27.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:26 smithi067 ceph-mon[35103]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:27.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:26 smithi007 ceph-mon[30588]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:27.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:26 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:27.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:26 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:27.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:26 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:27.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:26 smithi007 ceph-mon[30588]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:28.017 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:27 smithi116 ceph-mon[35109]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T18:11:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:27 smithi067 ceph-mon[35103]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T18:11:28.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:27 smithi007 ceph-mon[30588]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T18:11:29.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:28 smithi116 ceph-mon[35109]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:28 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/2541995469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]: dispatch 2024-09-13T18:11:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:28 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]: dispatch 2024-09-13T18:11:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:28 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]': finished 2024-09-13T18:11:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:28 smithi116 ceph-mon[35109]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T18:11:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:29.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:28 smithi067 ceph-mon[35103]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:29.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:28 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/2541995469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]: dispatch 2024-09-13T18:11:29.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:28 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]: dispatch 2024-09-13T18:11:29.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:28 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]': finished 2024-09-13T18:11:29.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:28 smithi067 ceph-mon[35103]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T18:11:29.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:28 smithi007 ceph-mon[30588]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:28 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/2541995469' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]: dispatch 2024-09-13T18:11:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:28 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]: dispatch 2024-09-13T18:11:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:28 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ac8d45a-bdc2-4afb-800f-0137f53371d3"}]': finished 2024-09-13T18:11:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:28 smithi007 ceph-mon[30588]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T18:11:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:30.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:29 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/1740937597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:29 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/1740937597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:30.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:29 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/1740937597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:31.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:30 smithi116 ceph-mon[35109]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:31.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:30 smithi067 ceph-mon[35103]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:30 smithi007 ceph-mon[30588]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:33 smithi007 ceph-mon[30588]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:33.868 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:33 smithi116 ceph-mon[35109]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:33 smithi067 ceph-mon[35103]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:35.678 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:35 smithi116 ceph-mon[35109]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:35 smithi007 ceph-mon[30588]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:35 smithi067 ceph-mon[35103]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:36.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T18:11:36.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:36.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T18:11:36.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T18:11:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:37.666 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:37 smithi116 ceph-mon[35109]: Deploying daemon osd.5 on smithi116 2024-09-13T18:11:37.666 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:37 smithi116 ceph-mon[35109]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:37.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:37 smithi007 ceph-mon[30588]: Deploying daemon osd.5 on smithi116 2024-09-13T18:11:37.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:37 smithi007 ceph-mon[30588]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:37 smithi067 ceph-mon[35103]: Deploying daemon osd.5 on smithi116 2024-09-13T18:11:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:37 smithi067 ceph-mon[35103]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:38 smithi007 ceph-mon[30588]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:38.841 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:38 smithi116 ceph-mon[35109]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:38 smithi067 ceph-mon[35103]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:41 smithi007 ceph-mon[30588]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:41.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:41.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:41 smithi116 ceph-mon[35109]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:41.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:41.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:41.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:41.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:41 smithi067 ceph-mon[35103]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:41.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:41.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:41.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:43 smithi007 ceph-mon[30588]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.933 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:43 smithi116 ceph-mon[35109]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:43.933 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.933 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.933 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:43.933 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:43.933 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:43 smithi067 ceph-mon[35103]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:44.284 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 5 on host 'smithi116' 2024-09-13T18:11:44.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.281+0000 7fe7137fe640 1 -- 172.21.15.116:0/4043634915 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe71c02c590 con 0x7fe7080a1080 2024-09-13T18:11:44.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7080a1080 msgr2=0x7fe7080a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:44.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7080a1080 0x7fe7080a3540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe71800a990 tx=0x7fe718005c70 comp rx=0 tx=0).stop 2024-09-13T18:11:44.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c100f60 msgr2=0x7fe71c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c100f60 0x7fe71c0728a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c9a0 tx=0x7fe70c00ce60 comp rx=0 tx=0).stop 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 shutdown_connections 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7080a1080 0x7fe7080a3540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe71c101920 0x7fe71c072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe71c100f60 0x7fe71c0728a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 --2- 172.21.15.116:0/4043634915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe71c0ffe00 0x7fe71c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 >> 172.21.15.116:0/4043634915 conn(0x7fe71c0fb590 msgr2=0x7fe71c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 shutdown_connections 2024-09-13T18:11:44.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:11:44.284+0000 7fe72449d640 1 -- 172.21.15.116:0/4043634915 wait complete. 2024-09-13T18:11:44.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:44 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:44.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:44 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:44.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:44 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:44.954 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:44 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:44.955 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:44 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:44.955 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:44 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:44.975 DEBUG:teuthology.orchestra.run.smithi116:osd.5> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T18:11:44.977 INFO:tasks.cephadm:Deploying osd.6 on smithi007 with /dev/vg_nvme/lv_2... 2024-09-13T18:11:44.977 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T18:11:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:44 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:11:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:44 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:44 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:45.303 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:11:45.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:45 smithi007 ceph-mon[30588]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:45.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:45 smithi007 ceph-mon[30588]: from='osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:11:45.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:45 smithi007 ceph-mon[30588]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:11:45.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:45 smithi116 ceph-mon[35109]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:45.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:45 smithi116 ceph-mon[35109]: from='osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:11:45.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:45 smithi116 ceph-mon[35109]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:11:45.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:45 smithi067 ceph-mon[35103]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:45.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:45 smithi067 ceph-mon[35103]: from='osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:11:45.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:45 smithi067 ceph-mon[35103]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:11:46.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:46 smithi007 ceph-mon[30588]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T18:11:46.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:46 smithi007 ceph-mon[30588]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T18:11:46.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:46.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:46 smithi007 ceph-mon[30588]: from='osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:11:46.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:46 smithi007 ceph-mon[30588]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:11:46.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:46 smithi007 ceph-mon[30588]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:46 smithi116 ceph-mon[35109]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T18:11:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:46 smithi116 ceph-mon[35109]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T18:11:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:46 smithi116 ceph-mon[35109]: from='osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:11:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:46 smithi116 ceph-mon[35109]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:11:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:46 smithi116 ceph-mon[35109]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:46 smithi067 ceph-mon[35103]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T18:11:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:46 smithi067 ceph-mon[35103]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T18:11:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:46 smithi067 ceph-mon[35103]: from='osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:11:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:46 smithi067 ceph-mon[35103]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:11:46.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:46 smithi067 ceph-mon[35103]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:47.269 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T18:11:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T18:11:47.421 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-09-13T18:11:47.421 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-09-13T18:11:47.422 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0276177 s, 380 MB/s 2024-09-13T18:11:47.422 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-09-13T18:11:47.552 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:11:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:11:47.371+0000 7f7c233be640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:11:47.552 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:11:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:11:47.383+0000 7f7c1a1b6640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:11:47.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:47 smithi007 ceph-mon[30588]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:11:47.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:47 smithi007 ceph-mon[30588]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T18:11:47.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:47.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:47 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:47.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:47 smithi007 ceph-mon[30588]: from='osd.5 ' entity='osd.5' 2024-09-13T18:11:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:47 smithi116 ceph-mon[35109]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:11:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:47 smithi116 ceph-mon[35109]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T18:11:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:47 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:47 smithi116 ceph-mon[35109]: from='osd.5 ' entity='osd.5' 2024-09-13T18:11:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:47 smithi067 ceph-mon[35103]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:11:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:47 smithi067 ceph-mon[35103]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T18:11:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:47 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:47 smithi067 ceph-mon[35103]: from='osd.5 ' entity='osd.5' 2024-09-13T18:11:48.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-09-13T18:11:48.507 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] boot 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi116 2024-09-13T18:11:48.825 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:48 smithi007 ceph-mon[30588]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] boot 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi116 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-13T18:11:48.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:48.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:48.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:48 smithi116 ceph-mon[35109]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:11:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:11:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: osd.5 [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] boot 2024-09-13T18:11:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T18:11:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi116 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi116 to 8544M 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:11:48.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:48 smithi067 ceph-mon[35103]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:11:49.949 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:49 smithi007 ceph-mon[30588]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T18:11:49.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:49 smithi116 ceph-mon[35109]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T18:11:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:49 smithi067 ceph-mon[35103]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T18:11:50.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 -- 172.21.15.7:0/1741564656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c076a50 msgr2=0x7f8d3c0772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1741564656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c076a50 0x7f8d3c0772f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009ca0 tx=0x7f8d3402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 -- 172.21.15.7:0/1741564656 shutdown_connections 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1741564656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c076a50 0x7f8d3c0772f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1741564656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d3c0760b0 0x7f8d3c076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1741564656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d3c074e60 0x7f8d3c075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 -- 172.21.15.7:0/1741564656 >> 172.21.15.7:0/1741564656 conn(0x7f8d3c0fd7a0 msgr2=0x7f8d3c0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 -- 172.21.15.7:0/1741564656 shutdown_connections 2024-09-13T18:11:50.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.338+0000 7f8d42c00640 1 -- 172.21.15.7:0/1741564656 wait complete. 2024-09-13T18:11:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 Processor -- start 2024-09-13T18:11:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 -- start start 2024-09-13T18:11:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c074e60 0x7f8d3c19c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d3c0760b0 0x7f8d3c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d3c076a50 0x7f8d3c1a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c1a3e80 con 0x7f8d3c074e60 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c1a3ff0 con 0x7f8d3c0760b0 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d42c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c1a41b0 con 0x7f8d3c076a50 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d3be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c074e60 0x7f8d3c19c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d33400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d3c0760b0 0x7f8d3c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.339+0000 7f8d3be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c074e60 0x7f8d3c19c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33302/0 (socket says 172.21.15.7:33302) 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d3be00640 1 -- 172.21.15.7:0/1570078889 learned_addr learned my addr 172.21.15.7:0/1570078889 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d40c00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d3c076a50 0x7f8d3c1a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d33400640 1 -- 172.21.15.7:0/1570078889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d3c076a50 msgr2=0x7f8d3c1a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d33400640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d3c076a50 0x7f8d3c1a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d33400640 1 -- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c074e60 msgr2=0x7f8d3c19c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d33400640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c074e60 0x7f8d3c19c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d33400640 1 -- 172.21.15.7:0/1570078889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34009900 con 0x7f8d3c0760b0 2024-09-13T18:11:50.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d33400640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d3c0760b0 0x7f8d3c19c8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400e9f0 tx=0x7f8d2400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:11:50.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.340+0000 7f8d39600640 1 -- 172.21.15.7:0/1570078889 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2400ccc0 con 0x7f8d3c0760b0 2024-09-13T18:11:50.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.341+0000 7f8d39600640 1 -- 172.21.15.7:0/1570078889 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d2400ce20 con 0x7f8d3c0760b0 2024-09-13T18:11:50.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.341+0000 7f8d39600640 1 -- 172.21.15.7:0/1570078889 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24004a00 con 0x7f8d3c0760b0 2024-09-13T18:11:50.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.341+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c1a4490 con 0x7f8d3c0760b0 2024-09-13T18:11:50.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.341+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c1a4940 con 0x7f8d3c0760b0 2024-09-13T18:11:50.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.342+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c10eb60 con 0x7f8d3c0760b0 2024-09-13T18:11:50.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.344+0000 7f8d39600640 1 -- 172.21.15.7:0/1570078889 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f8d24005020 con 0x7f8d3c0760b0 2024-09-13T18:11:50.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.346+0000 7f8d39600640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8d200a1130 0x7f8d200a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:11:50.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.346+0000 7f8d39600640 1 -- 172.21.15.7:0/1570078889 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4533+0+0 (secure 0 0 0) 0x7f8d24014070 con 0x7f8d3c0760b0 2024-09-13T18:11:50.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.346+0000 7f8d3be00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8d200a1130 0x7f8d200a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:11:50.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.346+0000 7f8d3be00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8d200a1130 0x7f8d200a35f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009c90 tx=0x7f8d2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:11:50.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.347+0000 7f8d39600640 1 -- 172.21.15.7:0/1570078889 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8d24096660 con 0x7f8d3c0760b0 2024-09-13T18:11:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:11:50.540+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d3c02c450 con 0x7f8d200a1130 2024-09-13T18:11:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:50 smithi116 ceph-mon[35109]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T18:11:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:50 smithi116 ceph-mon[35109]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:11:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:50 smithi067 ceph-mon[35103]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T18:11:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:50 smithi067 ceph-mon[35103]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:11:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:50 smithi007 ceph-mon[30588]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T18:11:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:50 smithi007 ceph-mon[30588]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:11:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:11:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:11:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:11:51.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:51 smithi007 ceph-mon[30588]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:51.923 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:51 smithi007 ceph-mon[30588]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T18:11:51.965 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:51 smithi116 ceph-mon[35109]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:51.965 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:51 smithi116 ceph-mon[35109]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T18:11:51.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:51 smithi067 ceph-mon[35103]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:11:51.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:51 smithi067 ceph-mon[35103]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T18:11:52.801 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:52 smithi007 ceph-mon[30588]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:11:52.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:52 smithi116 ceph-mon[35109]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:11:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:52 smithi067 ceph-mon[35103]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:11:53.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:53 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2303938003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]: dispatch 2024-09-13T18:11:53.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:53 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]: dispatch 2024-09-13T18:11:53.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:53 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]': finished 2024-09-13T18:11:53.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:53 smithi116 ceph-mon[35109]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T18:11:53.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:11:53.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:53 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2303938003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]: dispatch 2024-09-13T18:11:53.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:53 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]: dispatch 2024-09-13T18:11:53.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:53 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]': finished 2024-09-13T18:11:53.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:53 smithi067 ceph-mon[35103]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T18:11:53.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:11:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:53 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2303938003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]: dispatch 2024-09-13T18:11:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:53 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]: dispatch 2024-09-13T18:11:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:53 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9b1e65f-df07-4b3a-a539-d046476a6924"}]': finished 2024-09-13T18:11:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:53 smithi007 ceph-mon[30588]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T18:11:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:11:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:54 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3671272781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:54 smithi116 ceph-mon[35109]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-13T18:11:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:54 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3671272781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:54 smithi067 ceph-mon[35103]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-13T18:11:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:54 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3671272781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:11:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:54 smithi007 ceph-mon[30588]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-13T18:11:57.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:57 smithi007 ceph-mon[30588]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-13T18:11:57.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:57 smithi116 ceph-mon[35109]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-13T18:11:57.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:57 smithi067 ceph-mon[35103]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-13T18:11:59.721 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:11:59 smithi007 ceph-mon[30588]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:11:59.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:11:59 smithi116 ceph-mon[35109]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:11:59.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:11:59 smithi067 ceph-mon[35103]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:12:01.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:01 smithi007 ceph-mon[30588]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-13T18:12:01.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T18:12:01.787 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:01.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:01 smithi116 ceph-mon[35109]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-13T18:12:01.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T18:12:01.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:01.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:01 smithi067 ceph-mon[35103]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-13T18:12:01.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T18:12:01.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:02.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:02 smithi007 ceph-mon[30588]: Deploying daemon osd.6 on smithi007 2024-09-13T18:12:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:02 smithi116 ceph-mon[35109]: Deploying daemon osd.6 on smithi007 2024-09-13T18:12:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:02 smithi067 ceph-mon[35103]: Deploying daemon osd.6 on smithi007 2024-09-13T18:12:03.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:03 smithi007 ceph-mon[30588]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:12:03.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:03 smithi116 ceph-mon[35109]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:12:03.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:03 smithi067 ceph-mon[35103]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:12:04.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:04 smithi007 ceph-mon[30588]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T18:12:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:04 smithi116 ceph-mon[35109]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T18:12:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:04 smithi067 ceph-mon[35103]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T18:12:07.680 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:07 smithi007 ceph-mon[30588]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:07.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:07 smithi116 ceph-mon[35109]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:07 smithi067 ceph-mon[35103]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:08 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:08.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:08 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:08 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:09.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:09 smithi007 ceph-mon[30588]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:09.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:09 smithi116 ceph-mon[35109]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:09 smithi067 ceph-mon[35103]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:11.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:11 smithi007 ceph-mon[30588]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:11.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:11.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:11.712 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:11 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:11 smithi116 ceph-mon[35109]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:11.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:11.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:11.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:11 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:11 smithi067 ceph-mon[35103]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:11.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:11 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:11 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:11.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:11 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:11.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:11 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:11.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:11 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:12.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.351+0000 7f8d39600640 1 -- 172.21.15.7:0/1570078889 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8d3c02c450 con 0x7f8d200a1130 2024-09-13T18:12:12.354 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 6 on host 'smithi007' 2024-09-13T18:12:12.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.353+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8d200a1130 msgr2=0x7f8d200a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:12.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.353+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8d200a1130 0x7f8d200a35f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009c90 tx=0x7f8d2c005f90 comp rx=0 tx=0).stop 2024-09-13T18:12:12.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.353+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d3c0760b0 msgr2=0x7f8d3c19c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.353+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d3c0760b0 0x7f8d3c19c8c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400e9f0 tx=0x7f8d2400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 shutdown_connections 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8d200a1130 0x7f8d200a35f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d3c076a50 0x7f8d3c1a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d3c0760b0 0x7f8d3c19c8c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 --2- 172.21.15.7:0/1570078889 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d3c074e60 0x7f8d3c19c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 >> 172.21.15.7:0/1570078889 conn(0x7f8d3c0fd7a0 msgr2=0x7f8d3c0feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 shutdown_connections 2024-09-13T18:12:12.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:12:12.354+0000 7f8d42c00640 1 -- 172.21.15.7:0/1570078889 wait complete. 2024-09-13T18:12:12.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:12 smithi007 ceph-mon[30588]: from='osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T18:12:12.767 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:12 smithi007 ceph-mon[30588]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T18:12:12.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:12.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:12.768 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:12 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:12.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:12 smithi116 ceph-mon[35109]: from='osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T18:12:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:12 smithi116 ceph-mon[35109]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T18:12:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:12 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:12 smithi067 ceph-mon[35103]: from='osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T18:12:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:12 smithi067 ceph-mon[35103]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T18:12:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:12 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:13.062 DEBUG:teuthology.orchestra.run.smithi007:osd.6> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.6.service 2024-09-13T18:12:13.066 INFO:tasks.cephadm:Deploying osd.7 on smithi067 with /dev/vg_nvme/lv_2... 2024-09-13T18:12:13.067 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T18:12:13.278 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:12:13.552 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:13 smithi007 ceph-mon[30588]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:13.553 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:13 smithi007 ceph-mon[30588]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T18:12:13.553 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:13 smithi007 ceph-mon[30588]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T18:12:13.553 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:13.553 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:13 smithi007 ceph-mon[30588]: from='osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:12:13.553 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:13 smithi007 ceph-mon[30588]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:12:13.714 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:13 smithi067 ceph-mon[35103]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:13.714 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:13 smithi067 ceph-mon[35103]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T18:12:13.714 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:13 smithi067 ceph-mon[35103]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T18:12:13.714 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:13.714 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:13 smithi067 ceph-mon[35103]: from='osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:12:13.714 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:13 smithi067 ceph-mon[35103]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:12:13.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:13 smithi116 ceph-mon[35109]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:13.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:13 smithi116 ceph-mon[35109]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T18:12:13.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:13 smithi116 ceph-mon[35109]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T18:12:13.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:13.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:13 smithi116 ceph-mon[35109]: from='osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:12:13.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:13 smithi116 ceph-mon[35109]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:12:14.688 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:14 smithi067 ceph-mon[35103]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:12:14.688 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:14 smithi067 ceph-mon[35103]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T18:12:14.688 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:14.688 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:14.688 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:14 smithi067 ceph-mon[35103]: from='osd.6 ' entity='osd.6' 2024-09-13T18:12:14.688 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:14 smithi067 ceph-mon[35103]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:14.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-mon[30588]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:12:14.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-mon[30588]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T18:12:14.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:14.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:14.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-mon[30588]: from='osd.6 ' entity='osd.6' 2024-09-13T18:12:14.701 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-mon[30588]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:14.701 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:12:14.347+0000 7f0c90200640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:12:14.701 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:12:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:12:14.372+0000 7f0c84e00640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:12:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:14 smithi116 ceph-mon[35109]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:12:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:14 smithi116 ceph-mon[35109]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T18:12:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:14 smithi116 ceph-mon[35109]: from='osd.6 ' entity='osd.6' 2024-09-13T18:12:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:14 smithi116 ceph-mon[35109]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:12:15.033 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T18:12:15.119 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T18:12:15.132 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2024-09-13T18:12:15.133 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2024-09-13T18:12:15.133 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113829 s, 921 MB/s 2024-09-13T18:12:15.133 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2024-09-13T18:12:15.732 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:15 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:12:15.732 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:15 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:12:15.732 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:15.732 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:15 smithi067 ceph-mon[35103]: osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] boot 2024-09-13T18:12:15.732 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:15 smithi067 ceph-mon[35103]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T18:12:15.732 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:15.760 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_2 2024-09-13T18:12:15.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:15 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:12:15.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:15 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:12:15.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:15.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:15 smithi007 ceph-mon[30588]: osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] boot 2024-09-13T18:12:15.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:15 smithi007 ceph-mon[30588]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T18:12:15.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:15 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:12:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:15 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:12:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:15 smithi116 ceph-mon[35109]: osd.6 [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] boot 2024-09-13T18:12:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:15 smithi116 ceph-mon[35109]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T18:12:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T18:12:15.967 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:12:16.730 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:16 smithi067 ceph-mon[35103]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:16 smithi116 ceph-mon[35109]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:17.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:16 smithi007 ceph-mon[30588]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:17.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 -- 172.21.15.67:0/2624990296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8880fff00 msgr2=0x7fe888100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:17.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 --2- 172.21.15.67:0/2624990296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8880fff00 0x7fe888100380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe878009900 tx=0x7fe87802a410 comp rx=0 tx=0).stop 2024-09-13T18:12:17.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 -- 172.21.15.67:0/2624990296 shutdown_connections 2024-09-13T18:12:17.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 --2- 172.21.15.67:0/2624990296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8881008c0 0x7fe888107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:17.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 --2- 172.21.15.67:0/2624990296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8880fff00 0x7fe888100380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:17.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 --2- 172.21.15.67:0/2624990296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8880fed00 0x7fe8880ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 -- 172.21.15.67:0/2624990296 >> 172.21.15.67:0/2624990296 conn(0x7fe8880fa490 msgr2=0x7fe8880fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 -- 172.21.15.67:0/2624990296 shutdown_connections 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.448+0000 7fe890675640 1 -- 172.21.15.67:0/2624990296 wait complete. 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 Processor -- start 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 -- start start 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8880fed00 0x7fe888194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8880fff00 0x7fe8881951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8881008c0 0x7fe88819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88819c750 con 0x7fe8880fff00 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88819c8c0 con 0x7fe8881008c0 2024-09-13T18:12:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe890675640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88819ca80 con 0x7fe8880fed00 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe88ec12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8881008c0 0x7fe88819c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe88ec12640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8881008c0 0x7fe88819c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57668/0 (socket says 172.21.15.67:57668) 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe88ec12640 1 -- 172.21.15.67:0/1839759977 learned_addr learned my addr 172.21.15.67:0/1839759977 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe88e411640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8880fed00 0x7fe888194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.449+0000 7fe88dc10640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8880fff00 0x7fe8881951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe88ec12640 1 -- 172.21.15.67:0/1839759977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8880fed00 msgr2=0x7fe888194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe88ec12640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8880fed00 0x7fe888194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe88ec12640 1 -- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8880fff00 msgr2=0x7fe8881951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe88ec12640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8880fff00 0x7fe8881951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe88ec12640 1 -- 172.21.15.67:0/1839759977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009560 con 0x7fe8881008c0 2024-09-13T18:12:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe88ec12640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8881008c0 0x7fe88819c1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b970 tx=0x7fe88000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe87f7fe640 1 -- 172.21.15.67:0/1839759977 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000cb40 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe87f7fe640 1 -- 172.21.15.67:0/1839759977 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe88000cca0 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88819cd60 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe87f7fe640 1 -- 172.21.15.67:0/1839759977 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880007770 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.450+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88819d1b0 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.451+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe888106150 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.452+0000 7fe87f7fe640 1 -- 172.21.15.67:0/1839759977 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fe880014440 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.453+0000 7fe87f7fe640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe8740a1080 0x7fe8740a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.453+0000 7fe87f7fe640 1 -- 172.21.15.67:0/1839759977 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fe8800cb430 con 0x7fe8881008c0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.453+0000 7fe88e411640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe8740a1080 0x7fe8740a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.454+0000 7fe88e411640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe8740a1080 0x7fe8740a3540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe888196140 tx=0x7fe884005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:12:17.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.457+0000 7fe87f7fe640 1 -- 172.21.15.67:0/1839759977 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe880095980 con 0x7fe8881008c0 2024-09-13T18:12:17.549 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T18:12:17.549 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi007 2024-09-13T18:12:17.549 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:17.549 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:17.549 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:17.549 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:17.550 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:17.550 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi007 to 5698M 2024-09-13T18:12:17.550 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:17.550 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:17.550 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:17.550 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:17.638+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe88802c520 con 0x7fe8740a1080 2024-09-13T18:12:17.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi007 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi007 to 5698M 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi007 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi007 to 5698M 2024-09-13T18:12:18.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:18.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:18.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:18.024 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:18 smithi007 ceph-mon[30588]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:12:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:12:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:12:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:18 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:18 smithi007 ceph-mon[30588]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:18.864 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:18 smithi067 ceph-mon[35103]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:12:18.864 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:12:18.864 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:12:18.865 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:18 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:18.865 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:18 smithi067 ceph-mon[35103]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:18 smithi116 ceph-mon[35109]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:12:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:12:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:12:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:18 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:18 smithi116 ceph-mon[35109]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:20.175 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:19 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/132231228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]: dispatch 2024-09-13T18:12:20.175 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:19 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]: dispatch 2024-09-13T18:12:20.175 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:19 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]': finished 2024-09-13T18:12:20.176 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:19 smithi067 ceph-mon[35103]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T18:12:20.176 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:19 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:20.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:19 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/132231228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]: dispatch 2024-09-13T18:12:20.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:19 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]: dispatch 2024-09-13T18:12:20.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:19 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]': finished 2024-09-13T18:12:20.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:19 smithi116 ceph-mon[35109]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T18:12:20.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:19 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:20.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:19 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/132231228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]: dispatch 2024-09-13T18:12:20.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:19 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]: dispatch 2024-09-13T18:12:20.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:19 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3507f69-414b-44ad-ba04-76cc2a294486"}]': finished 2024-09-13T18:12:20.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:19 smithi007 ceph-mon[30588]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T18:12:20.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:19 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:21.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:20 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/2242131139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:12:21.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:20 smithi116 ceph-mon[35109]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:21.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:20 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/2242131139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:12:21.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:20 smithi067 ceph-mon[35103]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:21.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:20 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/2242131139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:12:21.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:20 smithi007 ceph-mon[30588]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:23.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:23 smithi007 ceph-mon[30588]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:23.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:23 smithi116 ceph-mon[35109]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:23 smithi067 ceph-mon[35103]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:25.735 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:25 smithi067 ceph-mon[35103]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:25.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:25 smithi007 ceph-mon[30588]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:25 smithi116 ceph-mon[35109]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:27.563 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:27 smithi067 ceph-mon[35103]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:27.563 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T18:12:27.563 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:27 smithi007 ceph-mon[30588]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T18:12:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:27.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:27 smithi116 ceph-mon[35109]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T18:12:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:28 smithi067 ceph-mon[35103]: Deploying daemon osd.7 on smithi067 2024-09-13T18:12:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:28 smithi067 ceph-mon[35103]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:28.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:28 smithi007 ceph-mon[30588]: Deploying daemon osd.7 on smithi067 2024-09-13T18:12:28.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:28 smithi007 ceph-mon[30588]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:28.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:28 smithi116 ceph-mon[35109]: Deploying daemon osd.7 on smithi067 2024-09-13T18:12:28.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:28 smithi116 ceph-mon[35109]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:31.575 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:31 smithi067 ceph-mon[35103]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:31.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:31 smithi007 ceph-mon[30588]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:31.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:31 smithi116 ceph-mon[35109]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:32.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:32.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:32.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:32.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:32.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:32.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:32.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:32.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:32.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:33.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:33 smithi067 ceph-mon[35103]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:33 smithi007 ceph-mon[30588]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:33.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:33 smithi116 ceph-mon[35109]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:34.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.624+0000 7fe87f7fe640 1 -- 172.21.15.67:0/1839759977 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe88802c520 con 0x7fe8740a1080 2024-09-13T18:12:34.627 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 7 on host 'smithi067' 2024-09-13T18:12:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe8740a1080 msgr2=0x7fe8740a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe8740a1080 0x7fe8740a3540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe888196140 tx=0x7fe884005f90 comp rx=0 tx=0).stop 2024-09-13T18:12:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8881008c0 msgr2=0x7fe88819c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8881008c0 0x7fe88819c1e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b970 tx=0x7fe88000be30 comp rx=0 tx=0).stop 2024-09-13T18:12:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 shutdown_connections 2024-09-13T18:12:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe8740a1080 0x7fe8740a3540 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8881008c0 0x7fe88819c1e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8880fff00 0x7fe8881951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 --2- 172.21.15.67:0/1839759977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8880fed00 0x7fe888194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 >> 172.21.15.67:0/1839759977 conn(0x7fe8880fa490 msgr2=0x7fe888103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:12:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 shutdown_connections 2024-09-13T18:12:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:12:34.626+0000 7fe890675640 1 -- 172.21.15.67:0/1839759977 wait complete. 2024-09-13T18:12:35.257 DEBUG:teuthology.orchestra.run.smithi067:osd.7> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.7.service 2024-09-13T18:12:35.259 INFO:tasks.cephadm:Deploying osd.8 on smithi116 with /dev/vg_nvme/lv_2... 2024-09-13T18:12:35.259 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T18:12:35.466 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:12:35.574 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:35 smithi116 ceph-mon[35109]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:35.574 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.574 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.574 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.574 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:35 smithi007 ceph-mon[30588]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.802 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:35 smithi067 ceph-mon[35103]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:35.802 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.802 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.803 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.803 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:35.803 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:12:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:12:35.597+0000 7f6f51025640 -1 osd.7 0 log_to_monitors true 2024-09-13T18:12:36.575 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:36 smithi067 ceph-mon[35103]: from='osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T18:12:36.575 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:36 smithi067 ceph-mon[35103]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T18:12:36.575 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:36 smithi067 ceph-mon[35103]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:36.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:36 smithi007 ceph-mon[30588]: from='osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T18:12:36.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:36 smithi007 ceph-mon[30588]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T18:12:36.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:36 smithi007 ceph-mon[30588]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:36.813 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:36 smithi116 ceph-mon[35109]: from='osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T18:12:36.813 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:36 smithi116 ceph-mon[35109]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T18:12:36.813 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:36 smithi116 ceph-mon[35109]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:37.319 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T18:12:37.408 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T18:12:37.421 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-09-13T18:12:37.422 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-09-13T18:12:37.422 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115242 s, 910 MB/s 2024-09-13T18:12:37.422 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-09-13T18:12:37.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:37 smithi116 ceph-mon[35109]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T18:12:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:37 smithi116 ceph-mon[35109]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T18:12:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:37 smithi116 ceph-mon[35109]: from='osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:12:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:37 smithi116 ceph-mon[35109]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:12:37.873 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:37 smithi067 ceph-mon[35103]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T18:12:37.873 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:37 smithi067 ceph-mon[35103]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T18:12:37.873 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:37.873 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:37 smithi067 ceph-mon[35103]: from='osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:12:37.873 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:37 smithi067 ceph-mon[35103]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:12:37.874 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:12:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:12:37.556+0000 7f6f4c783640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:12:37.874 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:12:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:12:37.572+0000 7f6f48dbe640 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:12:38.041 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_2 2024-09-13T18:12:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:37 smithi007 ceph-mon[30588]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T18:12:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:37 smithi007 ceph-mon[30588]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T18:12:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:37 smithi007 ceph-mon[30588]: from='osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:12:38.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:37 smithi007 ceph-mon[30588]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:12:38.239 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:12:38.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:12:38.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T18:12:38.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:38.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] boot 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi067 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:38.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:38 smithi116 ceph-mon[35109]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:12:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] boot 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi067 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:38.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:38.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:38 smithi067 ceph-mon[35103]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: osd.7 [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] boot 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi067 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:38 smithi007 ceph-mon[30588]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-13T18:12:39.634 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:39 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:12:39.635 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:39 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:12:39.635 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:39 smithi116 ceph-mon[35109]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 -- 172.21.15.116:0/3434279918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 msgr2=0x7f92cc1013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 --2- 172.21.15.116:0/3434279918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc1013e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009900 tx=0x7f92c002a410 comp rx=0 tx=0).stop 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 -- 172.21.15.116:0/3434279918 shutdown_connections 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 --2- 172.21.15.116:0/3434279918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92cc101920 0x7f92cc108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 --2- 172.21.15.116:0/3434279918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc1013e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 --2- 172.21.15.116:0/3434279918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92cc0ffe00 0x7f92cc100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 -- 172.21.15.116:0/3434279918 >> 172.21.15.116:0/3434279918 conn(0x7f92cc0fb5d0 msgr2=0x7f92cc0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 -- 172.21.15.116:0/3434279918 shutdown_connections 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.866+0000 7f92d1017640 1 -- 172.21.15.116:0/3434279918 wait complete. 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.867+0000 7f92d1017640 1 Processor -- start 2024-09-13T18:12:39.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92d1017640 1 -- start start 2024-09-13T18:12:39.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92d1017640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92cc0ffe00 0x7f92cc195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:39.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92d1017640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:39.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92d1017640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92cc101920 0x7f92cc19d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:39.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92d1017640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc19d910 con 0x7f92cc101920 2024-09-13T18:12:39.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92d1017640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc19da80 con 0x7f92cc0ffe00 2024-09-13T18:12:39.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92d1017640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc19dc40 con 0x7f92cc100f60 2024-09-13T18:12:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:12:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54864/0 (socket says 172.21.15.116:54864) 2024-09-13T18:12:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 -- 172.21.15.116:0/3991392867 learned_addr learned my addr 172.21.15.116:0/3991392867 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:12:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92cb59e640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92cc101920 0x7f92cc19d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:12:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 -- 172.21.15.116:0/3991392867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92cc0ffe00 msgr2=0x7f92cc195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92cc0ffe00 0x7f92cc195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:39.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 -- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92cc101920 msgr2=0x7f92cc19d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92cc101920 0x7f92cc19d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.868+0000 7f92ca59c640 1 -- 172.21.15.116:0/3991392867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009560 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.869+0000 7f92ca59c640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc196350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f92c00057c0 tx=0x7f92c0004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.869+0000 7f92b3fff640 1 -- 172.21.15.116:0/3991392867 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0004e00 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.869+0000 7f92b3fff640 1 -- 172.21.15.116:0/3991392867 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92c0046d10 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.869+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc0726e0 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.869+0000 7f92b3fff640 1 -- 172.21.15.116:0/3991392867 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c00315a0 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.869+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc072c50 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.870+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc107260 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.871+0000 7f92b3fff640 1 -- 172.21.15.116:0/3991392867 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f92c00036f0 con 0x7f92cc100f60 2024-09-13T18:12:39.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.872+0000 7f92b3fff640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f92b40a11b0 0x7f92b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:12:39.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.872+0000 7f92b3fff640 1 -- 172.21.15.116:0/3991392867 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f92c00f52d0 con 0x7f92cc100f60 2024-09-13T18:12:39.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.872+0000 7f92cad9d640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f92b40a11b0 0x7f92b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:12:39.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.873+0000 7f92cad9d640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f92b40a11b0 0x7f92b40a3670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009710 tx=0x7f92bc006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:12:39.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:39.875+0000 7f92b3fff640 1 -- 172.21.15.116:0/3991392867 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f92c00bf500 con 0x7f92cc100f60 2024-09-13T18:12:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:39 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:12:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:39 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:12:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:39 smithi067 ceph-mon[35103]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T18:12:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:39 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:12:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:39 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:12:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:39 smithi007 ceph-mon[30588]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T18:12:40.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:40.044+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f92cc02c4f0 con 0x7f92b40a11b0 2024-09-13T18:12:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:40 smithi116 ceph-mon[35109]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T18:12:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:40 smithi116 ceph-mon[35109]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:12:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:40 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:12:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:40 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:12:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:40 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:40 smithi116 ceph-mon[35109]: pgmap v180: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:40 smithi067 ceph-mon[35103]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T18:12:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:40 smithi067 ceph-mon[35103]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:12:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:40 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:12:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:40 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:12:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:40 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:40 smithi067 ceph-mon[35103]: pgmap v180: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:40 smithi007 ceph-mon[30588]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T18:12:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:40 smithi007 ceph-mon[30588]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:12:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:40 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:12:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:40 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:12:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:40 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:40 smithi007 ceph-mon[30588]: pgmap v180: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:41.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:41 smithi116 ceph-mon[35109]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T18:12:41.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:41 smithi067 ceph-mon[35103]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T18:12:42.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:41 smithi007 ceph-mon[30588]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T18:12:42.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:42 smithi116 ceph-mon[35109]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T18:12:42.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:42 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/596712943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]: dispatch 2024-09-13T18:12:42.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:42 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]: dispatch 2024-09-13T18:12:42.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:42 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]': finished 2024-09-13T18:12:42.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:42 smithi116 ceph-mon[35109]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T18:12:42.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:12:42.863 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:42 smithi116 ceph-mon[35109]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:42 smithi067 ceph-mon[35103]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T18:12:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:42 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/596712943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]: dispatch 2024-09-13T18:12:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:42 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]: dispatch 2024-09-13T18:12:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:42 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]': finished 2024-09-13T18:12:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:42 smithi067 ceph-mon[35103]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T18:12:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:12:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:42 smithi067 ceph-mon[35103]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:42 smithi007 ceph-mon[30588]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T18:12:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:42 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/596712943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]: dispatch 2024-09-13T18:12:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:42 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]: dispatch 2024-09-13T18:12:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:42 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d972ef6-53bc-46f7-830d-eee3d6b87547"}]': finished 2024-09-13T18:12:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:42 smithi007 ceph-mon[30588]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T18:12:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:12:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:42 smithi007 ceph-mon[30588]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:43.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:43 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/2350088933' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:12:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:43 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/2350088933' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:12:44.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:43 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/2350088933' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:12:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:44 smithi116 ceph-mon[35109]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:44 smithi067 ceph-mon[35103]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:45.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:44 smithi007 ceph-mon[30588]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:47.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:47 smithi007 ceph-mon[30588]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:47.824 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:47 smithi116 ceph-mon[35109]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:47 smithi067 ceph-mon[35103]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:49 smithi007 ceph-mon[30588]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T18:12:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:49.883 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:49 smithi116 ceph-mon[35109]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:49.884 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T18:12:49.884 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:49 smithi067 ceph-mon[35103]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T18:12:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:12:50.848 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:50 smithi116 ceph-mon[35109]: Deploying daemon osd.8 on smithi116 2024-09-13T18:12:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:50 smithi067 ceph-mon[35103]: Deploying daemon osd.8 on smithi116 2024-09-13T18:12:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:50 smithi007 ceph-mon[30588]: Deploying daemon osd.8 on smithi116 2024-09-13T18:12:51.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:51 smithi116 ceph-mon[35109]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:51.899 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:51 smithi067 ceph-mon[35103]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:52.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:51 smithi007 ceph-mon[30588]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:52.865 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:52 smithi116 ceph-mon[35109]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:52 smithi067 ceph-mon[35103]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:53.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:52 smithi007 ceph-mon[30588]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:55.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:55 smithi116 ceph-mon[35109]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:55.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:55 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:55.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:55 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:55.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:55 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:55 smithi007 ceph-mon[30588]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:55 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:55 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:55.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:55 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:55 smithi067 ceph-mon[35103]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:55 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:12:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:55 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:55 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:57.782 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:57 smithi116 ceph-mon[35109]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:57.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:57 smithi007 ceph-mon[30588]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.813+0000 7f92b3fff640 1 -- 172.21.15.116:0/3991392867 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f92cc02c4f0 con 0x7f92b40a11b0 2024-09-13T18:12:57.816 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 8 on host 'smithi116' 2024-09-13T18:12:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f92b40a11b0 msgr2=0x7f92b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f92b40a11b0 0x7f92b40a3670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009710 tx=0x7f92bc006c90 comp rx=0 tx=0).stop 2024-09-13T18:12:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 msgr2=0x7f92cc196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:12:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc196350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f92c00057c0 tx=0x7f92c0004740 comp rx=0 tx=0).stop 2024-09-13T18:12:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 shutdown_connections 2024-09-13T18:12:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f92b40a11b0 0x7f92b40a3670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92cc101920 0x7f92cc19d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92cc100f60 0x7f92cc196350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 --2- 172.21.15.116:0/3991392867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92cc0ffe00 0x7f92cc195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:12:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 >> 172.21.15.116:0/3991392867 conn(0x7f92cc0fb5d0 msgr2=0x7f92cc104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:12:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 shutdown_connections 2024-09-13T18:12:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:12:57.815+0000 7f92d1017640 1 -- 172.21.15.116:0/3991392867 wait complete. 2024-09-13T18:12:57.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:57 smithi067 ceph-mon[35103]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:58.474 DEBUG:teuthology.orchestra.run.smithi116:osd.8> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.8.service 2024-09-13T18:12:58.476 INFO:tasks.cephadm:Deploying osd.9 on smithi007 with /dev/vg_nvme/lv_1... 2024-09-13T18:12:58.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T18:12:58.712 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:12:58.594+0000 7f22e8960640 -1 osd.8 0 log_to_monitors true 2024-09-13T18:12:58.802 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:12:59.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:58 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:58 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:58 smithi007 ceph-mon[30588]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:59.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:58 smithi007 ceph-mon[30588]: from='osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T18:12:59.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:58 smithi007 ceph-mon[30588]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T18:12:59.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:58 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.073 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:58 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.095 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.096 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.096 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-mon[35109]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:59.096 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-mon[35109]: from='osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T18:12:59.096 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-mon[35109]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T18:12:59.096 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.097 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:58 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:58 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:58 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:58 smithi067 ceph-mon[35103]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:12:59.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:58 smithi067 ceph-mon[35103]: from='osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T18:12:59.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:58 smithi067 ceph-mon[35103]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T18:12:59.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:58 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:58 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:12:59.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:59 smithi007 ceph-mon[30588]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T18:12:59.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:59 smithi007 ceph-mon[30588]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T18:12:59.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:12:59.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:59 smithi007 ceph-mon[30588]: from='osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:12:59.943 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:12:59 smithi007 ceph-mon[30588]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:13:00.102 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:59 smithi116 ceph-mon[35109]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T18:13:00.102 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:59 smithi116 ceph-mon[35109]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T18:13:00.102 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:00.102 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:59 smithi116 ceph-mon[35109]: from='osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:13:00.102 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:12:59 smithi116 ceph-mon[35109]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:13:00.102 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:12:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:12:59.833+0000 7f22e40be640 -1 osd.8 0 waiting for initial osdmap 2024-09-13T18:13:00.102 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:12:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:12:59.845+0000 7f22e06f9640 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:13:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:59 smithi067 ceph-mon[35103]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T18:13:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:59 smithi067 ceph-mon[35103]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T18:13:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:59 smithi067 ceph-mon[35103]: from='osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:13:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:12:59 smithi067 ceph-mon[35103]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:13:00.998 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T18:13:00.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:00 smithi007 ceph-mon[30588]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:13:00.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:00 smithi007 ceph-mon[30588]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T18:13:00.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:00 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:00.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:00 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:00.998 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:00 smithi007 ceph-mon[30588]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:13:01.124 INFO:teuthology.orchestra.run.smithi007.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T18:13:01.157 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10+0 records in 2024-09-13T18:13:01.157 INFO:teuthology.orchestra.run.smithi007.stderr:10+0 records out 2024-09-13T18:13:01.158 INFO:teuthology.orchestra.run.smithi007.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0273037 s, 384 MB/s 2024-09-13T18:13:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:--> Zapping successful for: 2024-09-13T18:13:01.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:00 smithi116 ceph-mon[35109]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:13:01.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:00 smithi116 ceph-mon[35109]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T18:13:01.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:00 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:01.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:00 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:01.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:00 smithi116 ceph-mon[35109]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:13:01.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:00 smithi067 ceph-mon[35103]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:13:01.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:00 smithi067 ceph-mon[35103]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T18:13:01.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:00 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:01.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:00 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:01.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:00 smithi067 ceph-mon[35103]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T18:13:01.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] boot 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:02.212 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:01 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:13:02.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:13:02.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:02.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] boot 2024-09-13T18:13:02.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:02.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:02.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:02.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:02.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:02.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:01 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:13:02.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:13:02.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:02.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: osd.8 [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] boot 2024-09-13T18:13:02.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T18:13:02.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T18:13:02.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:02.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:01 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:02.311 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:13:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:02 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi116 2024-09-13T18:13:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:02 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-13T18:13:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:02 smithi067 ceph-mon[35103]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T18:13:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:02 smithi067 ceph-mon[35103]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:02 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi116 2024-09-13T18:13:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:02 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-13T18:13:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:02 smithi007 ceph-mon[30588]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T18:13:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:02 smithi007 ceph-mon[30588]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:03.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:02 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi116 2024-09-13T18:13:03.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:02 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi116 to 5696M 2024-09-13T18:13:03.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:02 smithi116 ceph-mon[35109]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T18:13:03.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:02 smithi116 ceph-mon[35109]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:04.036 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:03 smithi007 ceph-mon[30588]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T18:13:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.148+0000 7f36f3200640 1 -- 172.21.15.7:0/78738023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec074e60 msgr2=0x7f36ec075260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:04.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.148+0000 7f36f3200640 1 --2- 172.21.15.7:0/78738023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec074e60 0x7f36ec075260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009900 tx=0x7f36dc02a400 comp rx=0 tx=0).stop 2024-09-13T18:13:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.148+0000 7f36f3200640 1 -- 172.21.15.7:0/78738023 shutdown_connections 2024-09-13T18:13:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.148+0000 7f36f3200640 1 --2- 172.21.15.7:0/78738023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ec076a50 0x7f36ec0772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.148+0000 7f36f3200640 1 --2- 172.21.15.7:0/78738023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec0760b0 0x7f36ec076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.148+0000 7f36f3200640 1 --2- 172.21.15.7:0/78738023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec074e60 0x7f36ec075260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.148+0000 7f36f3200640 1 -- 172.21.15.7:0/78738023 >> 172.21.15.7:0/78738023 conn(0x7f36ec0fd7a0 msgr2=0x7f36ec0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:13:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.149+0000 7f36f3200640 1 -- 172.21.15.7:0/78738023 shutdown_connections 2024-09-13T18:13:04.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.149+0000 7f36f3200640 1 -- 172.21.15.7:0/78738023 wait complete. 2024-09-13T18:13:04.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.150+0000 7f36f3200640 1 Processor -- start 2024-09-13T18:13:04.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.150+0000 7f36f3200640 1 -- start start 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.150+0000 7f36f3200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec074e60 0x7f36ec19c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.150+0000 7f36f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec0760b0 0x7f36ec19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.150+0000 7f36f3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ec076a50 0x7f36ec1a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36f3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1a3e90 con 0x7f36ec0760b0 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36f3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1a4000 con 0x7f36ec076a50 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36f3200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1a41c0 con 0x7f36ec074e60 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36eb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec0760b0 0x7f36ec19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36ebe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec074e60 0x7f36ec19c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36ebe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec074e60 0x7f36ec19c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:55696/0 (socket says 172.21.15.7:55696) 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36ebe00640 1 -- 172.21.15.7:0/939453310 learned_addr learned my addr 172.21.15.7:0/939453310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36f1200640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ec076a50 0x7f36ec1a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36eb400640 1 -- 172.21.15.7:0/939453310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec074e60 msgr2=0x7f36ec19c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:04.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36eb400640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec074e60 0x7f36ec19c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:04.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36eb400640 1 -- 172.21.15.7:0/939453310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ec076a50 msgr2=0x7f36ec1a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:04.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36eb400640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ec076a50 0x7f36ec1a3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:04.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36eb400640 1 -- 172.21.15.7:0/939453310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009560 con 0x7f36ec0760b0 2024-09-13T18:13:04.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.151+0000 7f36ebe00640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec074e60 0x7f36ec19c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:13:04.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.152+0000 7f36eb400640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec0760b0 0x7f36ec19c8d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e9f0 tx=0x7f36d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:13:04.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.152+0000 7f36e8c00640 1 -- 172.21.15.7:0/939453310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800ccc0 con 0x7f36ec0760b0 2024-09-13T18:13:04.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.152+0000 7f36e8c00640 1 -- 172.21.15.7:0/939453310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36d800ce20 con 0x7f36ec0760b0 2024-09-13T18:13:04.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.152+0000 7f36e8c00640 1 -- 172.21.15.7:0/939453310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8004a00 con 0x7f36ec0760b0 2024-09-13T18:13:04.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.152+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec1a44a0 con 0x7f36ec0760b0 2024-09-13T18:13:04.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.152+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec1a4950 con 0x7f36ec0760b0 2024-09-13T18:13:04.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.153+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec10ebc0 con 0x7f36ec0760b0 2024-09-13T18:13:04.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.156+0000 7f36e8c00640 1 -- 172.21.15.7:0/939453310 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f36d8005020 con 0x7f36ec0760b0 2024-09-13T18:13:04.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.158+0000 7f36e8c00640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36d00a10b0 0x7f36d00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:04.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.158+0000 7f36e8c00640 1 -- 172.21.15.7:0/939453310 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f36d8014070 con 0x7f36ec0760b0 2024-09-13T18:13:04.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.158+0000 7f36ebe00640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36d00a10b0 0x7f36d00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:04.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.159+0000 7f36ebe00640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36d00a10b0 0x7f36d00a3570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f36dc005ec0 tx=0x7f36dc0314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:13:04.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.162+0000 7f36e8c00640 1 -- 172.21.15.7:0/939453310 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f36d8095f60 con 0x7f36ec0760b0 2024-09-13T18:13:04.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:03 smithi116 ceph-mon[35109]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T18:13:04.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:03 smithi067 ceph-mon[35103]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T18:13:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:04.352+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f36ec02c450 con 0x7f36d00a10b0 2024-09-13T18:13:05.130 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:04 smithi007 ceph-mon[30588]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T18:13:05.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:04 smithi007 ceph-mon[30588]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:05.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:05.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:05.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:05.131 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:04 smithi007 ceph-mon[30588]: pgmap v201: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:05.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:04 smithi116 ceph-mon[35109]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T18:13:05.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:04 smithi116 ceph-mon[35109]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:05.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:05.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:05.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:05.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:04 smithi116 ceph-mon[35109]: pgmap v201: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:05.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:04 smithi067 ceph-mon[35103]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T18:13:05.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:04 smithi067 ceph-mon[35103]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:05.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:05.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:05.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:05.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:04 smithi067 ceph-mon[35103]: pgmap v201: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:05.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:05 smithi007 ceph-mon[30588]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-13T18:13:05.900 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:05 smithi007 ceph-mon[30588]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T18:13:06.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:05 smithi116 ceph-mon[35109]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-13T18:13:06.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:05 smithi116 ceph-mon[35109]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T18:13:06.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:05 smithi067 ceph-mon[35103]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-13T18:13:06.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:05 smithi067 ceph-mon[35103]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T18:13:07.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:06 smithi116 ceph-mon[35109]: pgmap v203: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:06 smithi067 ceph-mon[35103]: pgmap v203: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:07.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:06 smithi007 ceph-mon[30588]: pgmap v203: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:08.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/134954761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612f22e2-8306-4302-ae63-359543549743"}]: dispatch 2024-09-13T18:13:08.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/134954761' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "612f22e2-8306-4302-ae63-359543549743"}]': finished 2024-09-13T18:13:08.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:07 smithi116 ceph-mon[35109]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T18:13:08.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:07 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:08.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/134954761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612f22e2-8306-4302-ae63-359543549743"}]: dispatch 2024-09-13T18:13:08.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/134954761' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "612f22e2-8306-4302-ae63-359543549743"}]': finished 2024-09-13T18:13:08.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:07 smithi067 ceph-mon[35103]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T18:13:08.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:07 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:08.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/134954761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612f22e2-8306-4302-ae63-359543549743"}]: dispatch 2024-09-13T18:13:08.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/134954761' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "612f22e2-8306-4302-ae63-359543549743"}]': finished 2024-09-13T18:13:08.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:07 smithi007 ceph-mon[30588]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T18:13:08.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:07 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:09.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:08 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3405689256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:09.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:08 smithi116 ceph-mon[35109]: pgmap v205: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:08 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3405689256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:08 smithi067 ceph-mon[35103]: pgmap v205: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:09.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:08 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3405689256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:09.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:08 smithi007 ceph-mon[30588]: pgmap v205: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-13T18:13:10.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:10 smithi007 ceph-mon[30588]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-13T18:13:10.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:10 smithi007 ceph-mon[30588]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-13T18:13:10.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:10 smithi007 ceph-mon[30588]: Cluster is now healthy 2024-09-13T18:13:10.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:10 smithi116 ceph-mon[35109]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-13T18:13:10.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:10 smithi116 ceph-mon[35109]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-13T18:13:10.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:10 smithi116 ceph-mon[35109]: Cluster is now healthy 2024-09-13T18:13:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:10 smithi067 ceph-mon[35103]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-13T18:13:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:10 smithi067 ceph-mon[35103]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-13T18:13:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:10 smithi067 ceph-mon[35103]: Cluster is now healthy 2024-09-13T18:13:13.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:13 smithi007 ceph-mon[30588]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:13:13.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:13 smithi116 ceph-mon[35109]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:13:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:13 smithi067 ceph-mon[35103]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:13:15.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:15 smithi007 ceph-mon[30588]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-13T18:13:15.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T18:13:15.843 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:15.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:15 smithi116 ceph-mon[35109]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-13T18:13:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T18:13:15.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:15.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:15 smithi067 ceph-mon[35103]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-13T18:13:15.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T18:13:15.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:16.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:16 smithi007 ceph-mon[30588]: Deploying daemon osd.9 on smithi007 2024-09-13T18:13:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:16 smithi116 ceph-mon[35109]: Deploying daemon osd.9 on smithi007 2024-09-13T18:13:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:16 smithi067 ceph-mon[35103]: Deploying daemon osd.9 on smithi007 2024-09-13T18:13:17.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:17 smithi007 ceph-mon[30588]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:13:17.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:17 smithi116 ceph-mon[35109]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:13:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:17 smithi067 ceph-mon[35103]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:13:18.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:18 smithi007 ceph-mon[30588]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T18:13:18.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:18 smithi116 ceph-mon[35109]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T18:13:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:18 smithi067 ceph-mon[35103]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-13T18:13:21.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:21 smithi007 ceph-mon[30588]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:13:21.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:21 smithi116 ceph-mon[35109]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:13:21.967 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:21 smithi067 ceph-mon[35103]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:13:22.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:22 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:22.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:22 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:22.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:22 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:22.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:22.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:22.882 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:22 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:22.890 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:22 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:22.890 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:22 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:22.891 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:22 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:23.910 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:23 smithi007 ceph-mon[30588]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:23.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:23 smithi116 ceph-mon[35109]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:23 smithi067 ceph-mon[35103]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:25.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.781+0000 7f36e8c00640 1 -- 172.21.15.7:0/939453310 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f36ec02c450 con 0x7f36d00a10b0 2024-09-13T18:13:25.784 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 9 on host 'smithi007' 2024-09-13T18:13:25.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36d00a10b0 msgr2=0x7f36d00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36d00a10b0 0x7f36d00a3570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f36dc005ec0 tx=0x7f36dc0314c0 comp rx=0 tx=0).stop 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec0760b0 msgr2=0x7f36ec19c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec0760b0 0x7f36ec19c8d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e9f0 tx=0x7f36d800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 shutdown_connections 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36d00a10b0 0x7f36d00a3570 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36ec076a50 0x7f36ec1a3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36ec0760b0 0x7f36ec19c8d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 --2- 172.21.15.7:0/939453310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36ec074e60 0x7f36ec19c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 >> 172.21.15.7:0/939453310 conn(0x7f36ec0fd7a0 msgr2=0x7f36ec0fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 shutdown_connections 2024-09-13T18:13:25.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:13:25.783+0000 7f36f3200640 1 -- 172.21.15.7:0/939453310 wait complete. 2024-09-13T18:13:25.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:25 smithi007 ceph-mon[30588]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:25 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.799 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:25 smithi007 ceph-mon[30588]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:13:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:25 smithi116 ceph-mon[35109]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:25 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:25 smithi116 ceph-mon[35109]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:13:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:25 smithi067 ceph-mon[35103]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:25 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:25 smithi067 ceph-mon[35103]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:13:26.546 DEBUG:teuthology.orchestra.run.smithi007:osd.9> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.9.service 2024-09-13T18:13:26.551 INFO:tasks.cephadm:Deploying osd.10 on smithi067 with /dev/vg_nvme/lv_1... 2024-09-13T18:13:26.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T18:13:26.762 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:13:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-mon[30588]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T18:13:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-mon[30588]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T18:13:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-mon[30588]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:13:26.882 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:26 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:26.883 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:26 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:26.883 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:26 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:26.883 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:26 smithi067 ceph-mon[35103]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T18:13:26.883 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:26 smithi067 ceph-mon[35103]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T18:13:26.883 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:26 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:26.883 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:26 smithi067 ceph-mon[35103]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:13:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:26 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:26 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:26 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:26 smithi116 ceph-mon[35109]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T18:13:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:26 smithi116 ceph-mon[35109]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T18:13:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:26 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:26 smithi116 ceph-mon[35109]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-13T18:13:27.176 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:13:26.942+0000 7f45ec600640 -1 osd.9 0 waiting for initial osdmap 2024-09-13T18:13:27.176 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:13:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:13:26.968+0000 7f45e8000640 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:13:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:27 smithi007 ceph-mon[30588]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:27 smithi007 ceph-mon[30588]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:13:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:27 smithi007 ceph-mon[30588]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T18:13:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:27.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:27 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:27.878 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:27 smithi067 ceph-mon[35103]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:27.879 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:27 smithi067 ceph-mon[35103]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:13:27.879 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:27 smithi067 ceph-mon[35103]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T18:13:27.879 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:27.879 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:27 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:27 smithi116 ceph-mon[35109]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:13:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:27 smithi116 ceph-mon[35109]: from='osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-13T18:13:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:27 smithi116 ceph-mon[35109]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T18:13:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:27 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:28.477 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T18:13:28.576 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T18:13:28.589 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2024-09-13T18:13:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2024-09-13T18:13:28.589 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115153 s, 911 MB/s 2024-09-13T18:13:28.589 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2024-09-13T18:13:29.209 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:28 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:13:29.210 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:28 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:13:29.210 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:28 smithi067 ceph-mon[35103]: osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] boot 2024-09-13T18:13:29.210 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:28 smithi067 ceph-mon[35103]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T18:13:29.210 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:29.210 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:28 smithi067 ceph-mon[35103]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:29.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:28 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:13:29.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:28 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:13:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:28 smithi116 ceph-mon[35109]: osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] boot 2024-09-13T18:13:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:28 smithi116 ceph-mon[35109]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T18:13:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:29.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:28 smithi116 ceph-mon[35109]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:29.230 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_1 2024-09-13T18:13:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:28 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:13:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:28 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:13:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:28 smithi007 ceph-mon[30588]: osd.9 [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] boot 2024-09-13T18:13:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:28 smithi007 ceph-mon[30588]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T18:13:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:13:29.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:28 smithi007 ceph-mon[30588]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:29.429 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:13:30.174 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:29 smithi067 ceph-mon[35103]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T18:13:30.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:29 smithi116 ceph-mon[35109]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T18:13:30.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:29 smithi007 ceph-mon[30588]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T18:13:30.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.924+0000 7f644e3fa640 1 -- 172.21.15.67:0/206032566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64481031d0 msgr2=0x7f64481055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.924+0000 7f644e3fa640 1 --2- 172.21.15.67:0/206032566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64481031d0 0x7f64481055c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f643c009900 tx=0x7f643c02a410 comp rx=0 tx=0).stop 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.924+0000 7f644e3fa640 1 -- 172.21.15.67:0/206032566 shutdown_connections 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.924+0000 7f644e3fa640 1 --2- 172.21.15.67:0/206032566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6448105b00 0x7f6448107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.924+0000 7f644e3fa640 1 --2- 172.21.15.67:0/206032566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64481031d0 0x7f64481055c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.924+0000 7f644e3fa640 1 --2- 172.21.15.67:0/206032566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64481008a0 0x7f6448102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.924+0000 7f644e3fa640 1 -- 172.21.15.67:0/206032566 >> 172.21.15.67:0/206032566 conn(0x7f64480fa4c0 msgr2=0x7f64480fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.925+0000 7f644e3fa640 1 -- 172.21.15.67:0/206032566 shutdown_connections 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.925+0000 7f644e3fa640 1 -- 172.21.15.67:0/206032566 wait complete. 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.925+0000 7f644e3fa640 1 Processor -- start 2024-09-13T18:13:30.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.925+0000 7f644e3fa640 1 -- start start 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644e3fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64481008a0 0x7f6448197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644e3fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64481031d0 0x7f6448198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644e3fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6448105b00 0x7f644819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644e3fa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644819fae0 con 0x7f64481031d0 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644e3fa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644819fc50 con 0x7f6448105b00 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644e3fa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644819fe10 con 0x7f64481008a0 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6448105b00 0x7f644819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6448105b00 0x7f644819f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60658/0 (socket says 172.21.15.67:60658) 2024-09-13T18:13:30.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 -- 172.21.15.67:0/3125505539 learned_addr learned my addr 172.21.15.67:0/3125505539 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f6447fff640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64481008a0 0x7f6448197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f64477fe640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64481031d0 0x7f6448198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 -- 172.21.15.67:0/3125505539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64481008a0 msgr2=0x7f6448197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64481008a0 0x7f6448197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 -- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64481031d0 msgr2=0x7f6448198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64481031d0 0x7f6448198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 -- 172.21.15.67:0/3125505539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c009560 con 0x7f6448105b00 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.926+0000 7f644c997640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6448105b00 0x7f644819f5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f644000eaa0 tx=0x7f644000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.927+0000 7f64457fa640 1 -- 172.21.15.67:0/3125505539 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000cdb0 con 0x7f6448105b00 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.927+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64481a00f0 con 0x7f6448105b00 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.927+0000 7f64457fa640 1 -- 172.21.15.67:0/3125505539 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6440005020 con 0x7f6448105b00 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.927+0000 7f64457fa640 1 -- 172.21.15.67:0/3125505539 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400116d0 con 0x7f6448105b00 2024-09-13T18:13:30.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.927+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64481a05c0 con 0x7f6448105b00 2024-09-13T18:13:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.928+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64480ff080 con 0x7f6448105b00 2024-09-13T18:13:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.929+0000 7f64457fa640 1 -- 172.21.15.67:0/3125505539 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f6440005190 con 0x7f6448105b00 2024-09-13T18:13:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.929+0000 7f64457fa640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f64300a10b0 0x7f64300a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:30.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.930+0000 7f64457fa640 1 -- 172.21.15.67:0/3125505539 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f64400cc6d0 con 0x7f6448105b00 2024-09-13T18:13:30.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.930+0000 7f6447fff640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f64300a10b0 0x7f64300a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:30.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.930+0000 7f6447fff640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f64300a10b0 0x7f64300a3570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64380058c0 tx=0x7f643800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:13:30.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:30.933+0000 7f64457fa640 1 -- 172.21.15.67:0/3125505539 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6440096660 con 0x7f6448105b00 2024-09-13T18:13:31.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:31.112+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6448106f50 con 0x7f64300a10b0 2024-09-13T18:13:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi007 2024-09-13T18:13:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-13T18:13:31.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:31.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:31.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:31 smithi007 ceph-mon[30588]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi007 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:31.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:31.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:31 smithi116 ceph-mon[35109]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:31.478 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi007 2024-09-13T18:13:31.478 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:31.479 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:31 smithi067 ceph-mon[35103]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:32.133 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:32 smithi067 ceph-mon[35103]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:32.133 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:32.134 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:32.134 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:32 smithi007 ceph-mon[30588]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:32.401 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:32 smithi116 ceph-mon[35109]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:32.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:32.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:32.402 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:33.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:33 smithi007 ceph-mon[30588]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:33.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:33 smithi116 ceph-mon[35109]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:33.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:33 smithi067 ceph-mon[35103]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:34 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/1338785397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]: dispatch 2024-09-13T18:13:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:34 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]: dispatch 2024-09-13T18:13:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:34 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]': finished 2024-09-13T18:13:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:34 smithi067 ceph-mon[35103]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T18:13:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:34.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:34 smithi067 ceph-mon[35103]: from='client.? 172.21.15.67:0/1783738803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:34 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/1338785397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]: dispatch 2024-09-13T18:13:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:34 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]: dispatch 2024-09-13T18:13:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:34 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]': finished 2024-09-13T18:13:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:34 smithi007 ceph-mon[30588]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T18:13:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:34 smithi007 ceph-mon[30588]: from='client.? 172.21.15.67:0/1783738803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:34.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:34 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/1338785397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]: dispatch 2024-09-13T18:13:34.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:34 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]: dispatch 2024-09-13T18:13:34.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:34 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44734350-17d9-43ed-9a32-6d52226d6a33"}]': finished 2024-09-13T18:13:34.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:34 smithi116 ceph-mon[35109]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T18:13:34.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:34.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:34 smithi116 ceph-mon[35109]: from='client.? 172.21.15.67:0/1783738803' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:35.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:35 smithi007 ceph-mon[30588]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:35.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:35 smithi116 ceph-mon[35109]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:35.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:35 smithi067 ceph-mon[35103]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:37.951 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:37 smithi067 ceph-mon[35103]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:37.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:37 smithi116 ceph-mon[35109]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:37 smithi007 ceph-mon[30588]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:39.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:39 smithi067 ceph-mon[35103]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:39.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:39 smithi116 ceph-mon[35109]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:39 smithi007 ceph-mon[30588]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:40.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:40 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T18:13:40.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:40 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:40.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:40 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T18:13:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:40 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:40 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T18:13:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:40 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:41.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:41 smithi067 ceph-mon[35103]: Deploying daemon osd.10 on smithi067 2024-09-13T18:13:41.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:41 smithi067 ceph-mon[35103]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:41.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:41 smithi116 ceph-mon[35109]: Deploying daemon osd.10 on smithi067 2024-09-13T18:13:41.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:41 smithi116 ceph-mon[35109]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:42.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:41 smithi007 ceph-mon[30588]: Deploying daemon osd.10 on smithi067 2024-09-13T18:13:42.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:41 smithi007 ceph-mon[30588]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:42.851 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:42 smithi067 ceph-mon[35103]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:42 smithi116 ceph-mon[35109]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:42 smithi007 ceph-mon[30588]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:45.826 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:45 smithi067 ceph-mon[35103]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:45.826 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:45 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:45.826 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:45 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:45.826 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:45 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:45.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:45 smithi116 ceph-mon[35109]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:45.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:45 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:45.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:45 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:45.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:45 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:46.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:45 smithi007 ceph-mon[30588]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:46.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:45 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:46.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:45 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:46.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:45 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:47.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:47 smithi067 ceph-mon[35103]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:47 smithi116 ceph-mon[35109]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:48.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:47 smithi007 ceph-mon[30588]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:48.157 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 10 on host 'smithi067' 2024-09-13T18:13:48.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.154+0000 7f64457fa640 1 -- 172.21.15.67:0/3125505539 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f6448106f50 con 0x7f64300a10b0 2024-09-13T18:13:48.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.157+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f64300a10b0 msgr2=0x7f64300a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:48.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.157+0000 7f644e3fa640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f64300a10b0 0x7f64300a3570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64380058c0 tx=0x7f643800a2d0 comp rx=0 tx=0).stop 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6448105b00 msgr2=0x7f644819f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6448105b00 0x7f644819f5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f644000eaa0 tx=0x7f644000ef60 comp rx=0 tx=0).stop 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 shutdown_connections 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f64300a10b0 0x7f64300a3570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6448105b00 0x7f644819f5a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64481031d0 0x7f6448198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 --2- 172.21.15.67:0/3125505539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64481008a0 0x7f6448197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 >> 172.21.15.67:0/3125505539 conn(0x7f64480fa4c0 msgr2=0x7f64481052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 shutdown_connections 2024-09-13T18:13:48.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-13T18:13:48.158+0000 7f644e3fa640 1 -- 172.21.15.67:0/3125505539 wait complete. 2024-09-13T18:13:48.726 DEBUG:teuthology.orchestra.run.smithi067:osd.10> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.10.service 2024-09-13T18:13:48.729 INFO:tasks.cephadm:Deploying osd.11 on smithi116 with /dev/vg_nvme/lv_1... 2024-09-13T18:13:48.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T18:13:48.936 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:13:49.357 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.357 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.357 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:49 smithi116 ceph-mon[35109]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:49.357 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.357 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.470 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.470 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.470 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:49 smithi067 ceph-mon[35103]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:49.470 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.470 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.471 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:13:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:13:49.249+0000 7f8a1851c640 -1 osd.10 0 log_to_monitors true 2024-09-13T18:13:49.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:49 smithi007 ceph-mon[30588]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:49.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:49.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:50.404 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:50 smithi116 ceph-mon[35109]: from='osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:13:50.404 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:50 smithi116 ceph-mon[35109]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:13:50.443 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:50 smithi067 ceph-mon[35103]: from='osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:13:50.443 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:50 smithi067 ceph-mon[35103]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:13:50.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:50 smithi007 ceph-mon[30588]: from='osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:13:50.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:50 smithi007 ceph-mon[30588]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:13:50.806 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T18:13:50.892 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T18:13:50.905 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-09-13T18:13:50.905 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-09-13T18:13:50.905 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114366 s, 917 MB/s 2024-09-13T18:13:50.905 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-09-13T18:13:51.414 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:13:51.168+0000 7f8a13c7a640 -1 osd.10 0 waiting for initial osdmap 2024-09-13T18:13:51.414 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:13:51.192+0000 7f8a102b5640 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:13:51.414 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-mon[35103]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T18:13:51.414 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-mon[35103]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T18:13:51.414 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:51.414 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-mon[35103]: from='osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:13:51.414 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-mon[35103]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:13:51.414 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:51 smithi067 ceph-mon[35103]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:51.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:51 smithi116 ceph-mon[35109]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T18:13:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:51 smithi116 ceph-mon[35109]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T18:13:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:51 smithi116 ceph-mon[35109]: from='osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:13:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:51 smithi116 ceph-mon[35109]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:13:51.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:51 smithi116 ceph-mon[35109]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:51.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:51 smithi007 ceph-mon[30588]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T18:13:51.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:51 smithi007 ceph-mon[30588]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T18:13:51.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:51.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:51 smithi007 ceph-mon[30588]: from='osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:13:51.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:51 smithi007 ceph-mon[30588]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2024-09-13T18:13:51.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:51 smithi007 ceph-mon[30588]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:13:51.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_1 2024-09-13T18:13:51.846 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:13:52.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:13:52.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T18:13:52.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:52.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:52.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:52.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] boot 2024-09-13T18:13:52.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T18:13:52.463 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:52 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:13:52.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T18:13:52.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:52.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:52.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] boot 2024-09-13T18:13:52.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T18:13:52.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:52 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-13T18:13:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T18:13:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:13:52.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:52.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:13:52.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:13:52.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: osd.10 [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] boot 2024-09-13T18:13:52.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T18:13:52.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:52 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:13:53.318 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:53 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:13:53.318 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:53 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:13:53.318 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:53 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi067 2024-09-13T18:13:53.318 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:53 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-13T18:13:53.318 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:53 smithi067 ceph-mon[35103]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:53.318 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:53 smithi067 ceph-mon[35103]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T18:13:53.373 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:53 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:13:53.374 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:53 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:13:53.374 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:53 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi067 2024-09-13T18:13:53.374 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:53 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-13T18:13:53.374 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:53 smithi116 ceph-mon[35109]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:53.374 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:53 smithi116 ceph-mon[35109]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T18:13:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:53 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:13:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:53 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:13:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:53 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi067 2024-09-13T18:13:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:53 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-13T18:13:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:53 smithi007 ceph-mon[30588]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:53 smithi007 ceph-mon[30588]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T18:13:53.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.574+0000 7fe11079c640 1 -- 172.21.15.116:0/3217875712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103200 msgr2=0x7fe108103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:53.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.574+0000 7fe11079c640 1 --2- 172.21.15.116:0/3217875712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103200 0x7fe108103680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009900 tx=0x7fe0fc02a410 comp rx=0 tx=0).stop 2024-09-13T18:13:53.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- 172.21.15.116:0/3217875712 shutdown_connections 2024-09-13T18:13:53.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 --2- 172.21.15.116:0/3217875712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe108103bc0 0x7fe10810a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 --2- 172.21.15.116:0/3217875712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103200 0x7fe108103680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 --2- 172.21.15.116:0/3217875712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108102000 0x7fe108102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- 172.21.15.116:0/3217875712 >> 172.21.15.116:0/3217875712 conn(0x7fe1080fd790 msgr2=0x7fe1080ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- 172.21.15.116:0/3217875712 shutdown_connections 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- 172.21.15.116:0/3217875712 wait complete. 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 Processor -- start 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- start start 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108102000 0x7fe108197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe108103200 0x7fe108198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103bc0 0x7fe10819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10819fad0 con 0x7fe108102000 2024-09-13T18:13:53.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10819fc40 con 0x7fe108103200 2024-09-13T18:13:53.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.575+0000 7fe11079c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10819fe00 con 0x7fe108103bc0 2024-09-13T18:13:53.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103bc0 0x7fe10819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:53.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103bc0 0x7fe10819f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56210/0 (socket says 172.21.15.116:56210) 2024-09-13T18:13:53.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 -- 172.21.15.116:0/3770599977 learned_addr learned my addr 172.21.15.116:0/3770599977 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:13:53.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10dd37640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe108103200 0x7fe108198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:53.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 -- 172.21.15.116:0/3770599977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe108103200 msgr2=0x7fe108198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:53.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10e538640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108102000 0x7fe108197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:53.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe108103200 0x7fe108198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:53.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 -- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108102000 msgr2=0x7fe108197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:13:53.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108102000 0x7fe108197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 -- 172.21.15.116:0/3770599977 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009560 con 0x7fe108103bc0 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10e538640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108102000 0x7fe108197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe10ed39640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103bc0 0x7fe10819f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe10000d750 tx=0x7fe10000dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe1077fe640 1 -- 172.21.15.116:0/3770599977 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100009bd0 con 0x7fe108103bc0 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1081a00e0 con 0x7fe108103bc0 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe1077fe640 1 -- 172.21.15.116:0/3770599977 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe10000de60 con 0x7fe108103bc0 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe1077fe640 1 -- 172.21.15.116:0/3770599977 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100004e00 con 0x7fe108103bc0 2024-09-13T18:13:53.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.576+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1081a0630 con 0x7fe108103bc0 2024-09-13T18:13:53.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.577+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe108109450 con 0x7fe108103bc0 2024-09-13T18:13:53.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.578+0000 7fe1077fe640 1 -- 172.21.15.116:0/3770599977 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fe100004f60 con 0x7fe108103bc0 2024-09-13T18:13:53.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.579+0000 7fe1077fe640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe0f00a10b0 0x7fe0f00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:13:53.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.579+0000 7fe1077fe640 1 -- 172.21.15.116:0/3770599977 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fe1000cbc00 con 0x7fe108103bc0 2024-09-13T18:13:53.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.579+0000 7fe10e538640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe0f00a10b0 0x7fe0f00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:13:53.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.580+0000 7fe10e538640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe0f00a10b0 0x7fe0f00a3570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe108103060 tx=0x7fe0f80073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:13:53.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.583+0000 7fe1077fe640 1 -- 172.21.15.116:0/3770599977 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe1000d2080 con 0x7fe108103bc0 2024-09-13T18:13:53.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:13:53.759+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe10802c450 con 0x7fe0f00a10b0 2024-09-13T18:13:54.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:54 smithi116 ceph-mon[35109]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T18:13:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:54 smithi116 ceph-mon[35109]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:54 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:54 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:54 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:54 smithi116 ceph-mon[35109]: pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:55.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:54 smithi067 ceph-mon[35103]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T18:13:55.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:54 smithi067 ceph-mon[35103]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:55.000 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:54 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:55.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:54 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:55.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:54 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:55.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:54 smithi067 ceph-mon[35103]: pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:54 smithi007 ceph-mon[30588]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T18:13:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:54 smithi007 ceph-mon[30588]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:13:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:54 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:13:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:54 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:13:55.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:54 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:13:55.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:54 smithi007 ceph-mon[30588]: pgmap v238: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:55.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:55 smithi116 ceph-mon[35109]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T18:13:55.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:55 smithi067 ceph-mon[35103]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T18:13:56.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:55 smithi007 ceph-mon[30588]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T18:13:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:56 smithi116 ceph-mon[35109]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T18:13:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:56 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/2083601739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]: dispatch 2024-09-13T18:13:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:56 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]: dispatch 2024-09-13T18:13:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:56 smithi116 ceph-mon[35109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]': finished 2024-09-13T18:13:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:56 smithi116 ceph-mon[35109]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T18:13:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:13:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:56 smithi116 ceph-mon[35109]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:56 smithi067 ceph-mon[35103]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T18:13:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:56 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/2083601739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]: dispatch 2024-09-13T18:13:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:56 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]: dispatch 2024-09-13T18:13:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:56 smithi067 ceph-mon[35103]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]': finished 2024-09-13T18:13:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:56 smithi067 ceph-mon[35103]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T18:13:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:13:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:56 smithi067 ceph-mon[35103]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:56 smithi007 ceph-mon[30588]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T18:13:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:56 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/2083601739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]: dispatch 2024-09-13T18:13:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:56 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]: dispatch 2024-09-13T18:13:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:56 smithi007 ceph-mon[30588]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e90836c-ffe2-434a-b93c-520c3ef9652b"}]': finished 2024-09-13T18:13:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:56 smithi007 ceph-mon[30588]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T18:13:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:13:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:56 smithi007 ceph-mon[30588]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:57.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:57 smithi116 ceph-mon[35109]: from='client.? 172.21.15.116:0/2180285876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:57.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:57 smithi067 ceph-mon[35103]: from='client.? 172.21.15.116:0/2180285876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:58.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:57 smithi007 ceph-mon[30588]: from='client.? 172.21.15.116:0/2180285876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:13:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:13:58 smithi067 ceph-mon[35103]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:59.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:13:58 smithi007 ceph-mon[30588]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:13:59.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:13:58 smithi116 ceph-mon[35109]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:14:01.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:01 smithi116 ceph-mon[35109]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:14:01.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:01 smithi067 ceph-mon[35103]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:14:02.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:01 smithi007 ceph-mon[30588]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:14:03.901 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:03 smithi116 ceph-mon[35109]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T18:14:03.901 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T18:14:03.901 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:03.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:03 smithi067 ceph-mon[35103]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T18:14:03.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T18:14:03.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:04.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:03 smithi007 ceph-mon[30588]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-13T18:14:04.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T18:14:04.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:04.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:04 smithi067 ceph-mon[35103]: Deploying daemon osd.11 on smithi116 2024-09-13T18:14:04.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:04 smithi067 ceph-mon[35103]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T18:14:04.914 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:04 smithi116 ceph-mon[35109]: Deploying daemon osd.11 on smithi116 2024-09-13T18:14:04.914 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:04 smithi116 ceph-mon[35109]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T18:14:05.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:04 smithi007 ceph-mon[30588]: Deploying daemon osd.11 on smithi116 2024-09-13T18:14:05.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:04 smithi007 ceph-mon[30588]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T18:14:07.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:07 smithi116 ceph-mon[35109]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T18:14:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:07 smithi067 ceph-mon[35103]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T18:14:08.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:07 smithi007 ceph-mon[30588]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T18:14:09.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:09 smithi116 ceph-mon[35109]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:14:09.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:09.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:09.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:09 smithi067 ceph-mon[35103]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:14:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:09 smithi007 ceph-mon[30588]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:14:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:10.795 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:10 smithi116 ceph-mon[35109]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:14:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:10 smithi067 ceph-mon[35103]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:14:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:10 smithi007 ceph-mon[30588]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:14:12.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.062+0000 7fe1077fe640 1 -- 172.21.15.116:0/3770599977 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fe10802c450 con 0x7fe0f00a10b0 2024-09-13T18:14:12.065 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 11 on host 'smithi116' 2024-09-13T18:14:12.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.064+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe0f00a10b0 msgr2=0x7fe0f00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:12.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.064+0000 7fe11079c640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe0f00a10b0 0x7fe0f00a3570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe108103060 tx=0x7fe0f80073c0 comp rx=0 tx=0).stop 2024-09-13T18:14:12.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.064+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103bc0 msgr2=0x7fe10819f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:12.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.064+0000 7fe11079c640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103bc0 0x7fe10819f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe10000d750 tx=0x7fe10000dc10 comp rx=0 tx=0).stop 2024-09-13T18:14:12.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 shutdown_connections 2024-09-13T18:14:12.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe0f00a10b0 0x7fe0f00a3570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:12.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe108103bc0 0x7fe10819f590 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:12.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe108103200 0x7fe108198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:12.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 --2- 172.21.15.116:0/3770599977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe108102000 0x7fe108197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:12.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 >> 172.21.15.116:0/3770599977 conn(0x7fe1080fd790 msgr2=0x7fe108106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:12.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 shutdown_connections 2024-09-13T18:14:12.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:12.065+0000 7fe11079c640 1 -- 172.21.15.116:0/3770599977 wait complete. 2024-09-13T18:14:12.744 DEBUG:teuthology.orchestra.run.smithi116:osd.11> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.11.service 2024-09-13T18:14:12.746 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-13T18:14:12.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T18:14:13.097 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:14:13.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:13 smithi007 ceph-mon[30588]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:14:13.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:13 smithi007 ceph-mon[30588]: from='osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:14:13.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:13 smithi007 ceph-mon[30588]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:14:13.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:13 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.355 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.355 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.355 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:13 smithi116 ceph-mon[35109]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:14:13.355 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:13 smithi116 ceph-mon[35109]: from='osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:14:13.355 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:13 smithi116 ceph-mon[35109]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:14:13.355 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.356 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:13 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:13 smithi067 ceph-mon[35103]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:14:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:13 smithi067 ceph-mon[35103]: from='osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:14:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:13 smithi067 ceph-mon[35103]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:14:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:13 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:14.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:14 smithi007 ceph-mon[30588]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T18:14:14.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:14 smithi007 ceph-mon[30588]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T18:14:14.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:14 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:14.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:14 smithi007 ceph-mon[30588]: from='osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:14:14.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:14 smithi007 ceph-mon[30588]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:14:14.330 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:14 smithi116 ceph-mon[35109]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T18:14:14.330 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:14 smithi116 ceph-mon[35109]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T18:14:14.330 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:14 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:14.330 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:14 smithi116 ceph-mon[35109]: from='osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:14:14.330 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:14 smithi116 ceph-mon[35109]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:14:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:14 smithi067 ceph-mon[35103]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T18:14:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:14 smithi067 ceph-mon[35103]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T18:14:14.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:14 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:14.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:14 smithi067 ceph-mon[35103]: from='osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:14:14.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:14 smithi067 ceph-mon[35103]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-09-13T18:14:14.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 -- 172.21.15.7:0/1990619356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 msgr2=0x7ffb280772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:14.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1990619356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 0x7ffb280772f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009ca0 tx=0x7ffb2002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:14:14.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 -- 172.21.15.7:0/1990619356 shutdown_connections 2024-09-13T18:14:14.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1990619356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 0x7ffb280772f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:14.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1990619356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb280760b0 0x7ffb28076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:14.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1990619356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb28074e60 0x7ffb28075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:14.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 -- 172.21.15.7:0/1990619356 >> 172.21.15.7:0/1990619356 conn(0x7ffb280fd7a0 msgr2=0x7ffb280ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:14.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 -- 172.21.15.7:0/1990619356 shutdown_connections 2024-09-13T18:14:14.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.857+0000 7ffb2e000640 1 -- 172.21.15.7:0/1990619356 wait complete. 2024-09-13T18:14:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.858+0000 7ffb2e000640 1 Processor -- start 2024-09-13T18:14:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.858+0000 7ffb2e000640 1 -- start start 2024-09-13T18:14:14.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb2e000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb28074e60 0x7ffb2819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb2e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb280760b0 0x7ffb2819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb2e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 0x7ffb281a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb2e000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb281a3de0 con 0x7ffb28076a50 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb2e000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb281a3f50 con 0x7ffb280760b0 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb2e000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb281a4110 con 0x7ffb28074e60 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb28074e60 0x7ffb2819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb28074e60 0x7ffb2819c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:46362/0 (socket says 172.21.15.7:46362) 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 -- 172.21.15.7:0/1238174824 learned_addr learned my addr 172.21.15.7:0/1238174824 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb1fe00640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb280760b0 0x7ffb2819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27e00640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 0x7ffb281a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 -- 172.21.15.7:0/1238174824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb280760b0 msgr2=0x7ffb2819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb280760b0 0x7ffb2819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 -- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 msgr2=0x7ffb281a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 0x7ffb281a38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.859+0000 7ffb27400640 1 -- 172.21.15.7:0/1238174824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20009900 con 0x7ffb28074e60 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.860+0000 7ffb27400640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb28074e60 0x7ffb2819c2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e9f0 tx=0x7ffb1800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.860+0000 7ffb24c00640 1 -- 172.21.15.7:0/1238174824 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18009700 con 0x7ffb28074e60 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.860+0000 7ffb24c00640 1 -- 172.21.15.7:0/1238174824 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb1800cd80 con 0x7ffb28074e60 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.860+0000 7ffb24c00640 1 -- 172.21.15.7:0/1238174824 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18018860 con 0x7ffb28074e60 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.860+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb281a43f0 con 0x7ffb28074e60 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.860+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb281a48a0 con 0x7ffb28074e60 2024-09-13T18:14:14.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.861+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2810eb00 con 0x7ffb28074e60 2024-09-13T18:14:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.863+0000 7ffb24c00640 1 -- 172.21.15.7:0/1238174824 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7ffb180189c0 con 0x7ffb28074e60 2024-09-13T18:14:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.864+0000 7ffb24c00640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb0c0a10b0 0x7ffb0c0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.864+0000 7ffb24c00640 1 -- 172.21.15.7:0/1238174824 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7ffb18014070 con 0x7ffb28074e60 2024-09-13T18:14:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.864+0000 7ffb1fe00640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb0c0a10b0 0x7ffb0c0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.865+0000 7ffb1fe00640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb0c0a10b0 0x7ffb0c0a3570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb2819d800 tx=0x7ffb1000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:14.868+0000 7ffb24c00640 1 -- 172.21.15.7:0/1238174824 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb18052e20 con 0x7ffb28074e60 2024-09-13T18:14:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.054+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ffb2802c3e0 con 0x7ffb28074e60 2024-09-13T18:14:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.055+0000 7ffb24c00640 1 -- 172.21.15.7:0/1238174824 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7ffb18096420 con 0x7ffb28074e60 2024-09-13T18:14:15.057 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb0c0a10b0 msgr2=0x7ffb0c0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb0c0a10b0 0x7ffb0c0a3570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb2819d800 tx=0x7ffb1000b410 comp rx=0 tx=0).stop 2024-09-13T18:14:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb28074e60 msgr2=0x7ffb2819c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb28074e60 0x7ffb2819c2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e9f0 tx=0x7ffb1800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:14:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 shutdown_connections 2024-09-13T18:14:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb0c0a10b0 0x7ffb0c0a3570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb28076a50 0x7ffb281a38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb280760b0 0x7ffb2819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 --2- 172.21.15.7:0/1238174824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb28074e60 0x7ffb2819c2e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.057+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 >> 172.21.15.7:0/1238174824 conn(0x7ffb280fd7a0 msgr2=0x7ffb280feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.058+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 shutdown_connections 2024-09-13T18:14:15.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:15.058+0000 7ffb2e000640 1 -- 172.21.15.7:0/1238174824 wait complete. 2024-09-13T18:14:15.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:15 smithi116 ceph-mon[35109]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:14:15.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:15 smithi116 ceph-mon[35109]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T18:14:15.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:15.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:15 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:15.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:15 smithi116 ceph-mon[35109]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:14:15.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:15 smithi116 ceph-mon[35109]: from='osd.11 ' entity='osd.11' 2024-09-13T18:14:15.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:15 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1238174824' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:14:15.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:14:14 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:14:14.874+0000 7fe3bb737640 -1 osd.11 0 waiting for initial osdmap 2024-09-13T18:14:15.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:14:14 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:14:14.897+0000 7fe3b3d6a640 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:14:15.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:15 smithi007 ceph-mon[30588]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:14:15.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:15 smithi007 ceph-mon[30588]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T18:14:15.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:15.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:15 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:15.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:15 smithi007 ceph-mon[30588]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:14:15.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:15 smithi007 ceph-mon[30588]: from='osd.11 ' entity='osd.11' 2024-09-13T18:14:15.384 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:15 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1238174824' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:14:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:15 smithi067 ceph-mon[35103]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-09-13T18:14:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:15 smithi067 ceph-mon[35103]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T18:14:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:15 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:15 smithi067 ceph-mon[35103]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:14:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:15 smithi067 ceph-mon[35103]: from='osd.11 ' entity='osd.11' 2024-09-13T18:14:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:15 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1238174824' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:14:15.732 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1726251232,"num_in_osds":12,"osd_in_since":1726251236,"num_remapped_pgs":0} 2024-09-13T18:14:16.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:16 smithi116 ceph-mon[35109]: purged_snaps scrub starts 2024-09-13T18:14:16.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:16 smithi116 ceph-mon[35109]: purged_snaps scrub ok 2024-09-13T18:14:16.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:16 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:16.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:16 smithi116 ceph-mon[35109]: osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] boot 2024-09-13T18:14:16.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:16 smithi116 ceph-mon[35109]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T18:14:16.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:16 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:16 smithi067 ceph-mon[35103]: purged_snaps scrub starts 2024-09-13T18:14:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:16 smithi067 ceph-mon[35103]: purged_snaps scrub ok 2024-09-13T18:14:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:16 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:16 smithi067 ceph-mon[35103]: osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] boot 2024-09-13T18:14:16.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:16 smithi067 ceph-mon[35103]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T18:14:16.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:16 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:16.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:16 smithi007 ceph-mon[30588]: purged_snaps scrub starts 2024-09-13T18:14:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:16 smithi007 ceph-mon[30588]: purged_snaps scrub ok 2024-09-13T18:14:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:16 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:16 smithi007 ceph-mon[30588]: osd.11 [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] boot 2024-09-13T18:14:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:16 smithi007 ceph-mon[30588]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T18:14:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:16 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:14:16.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T18:14:17.052 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:14:17.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: Detected new or changed devices on smithi116 2024-09-13T18:14:17.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:17 smithi007 ceph-mon[30588]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: Detected new or changed devices on smithi116 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-13T18:14:17.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:17 smithi116 ceph-mon[35109]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: Detected new or changed devices on smithi116 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:14:17.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi116 to 4272M 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:17.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:17 smithi067 ceph-mon[35103]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:18.466 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:18 smithi007 ceph-mon[30588]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T18:14:18.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:18 smithi116 ceph-mon[35109]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T18:14:18.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:18 smithi067 ceph-mon[35103]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T18:14:18.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 -- 172.21.15.7:0/17838154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 msgr2=0x7f4804107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 --2- 172.21.15.7:0/17838154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 0x7f4804107a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009900 tx=0x7f47f002a3e0 comp rx=0 tx=0).stop 2024-09-13T18:14:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 -- 172.21.15.7:0/17838154 shutdown_connections 2024-09-13T18:14:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 --2- 172.21.15.7:0/17838154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4804107fb0 0x7f480410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 --2- 172.21.15.7:0/17838154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 0x7f4804107a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:18.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 --2- 172.21.15.7:0/17838154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 0x7f4804106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 -- 172.21.15.7:0/17838154 >> 172.21.15.7:0/17838154 conn(0x7f48040756c0 msgr2=0x7f4804077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 -- 172.21.15.7:0/17838154 shutdown_connections 2024-09-13T18:14:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.820+0000 7f4809000640 1 -- 172.21.15.7:0/17838154 wait complete. 2024-09-13T18:14:18.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.821+0000 7f4809000640 1 Processor -- start 2024-09-13T18:14:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.821+0000 7f4809000640 1 -- start start 2024-09-13T18:14:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4809000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 0x7f480419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:18.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4809000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 0x7f480419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4809000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4804107fb0 0x7f48041a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4809000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041a3e70 con 0x7f48041075f0 2024-09-13T18:14:18.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4809000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041a3fe0 con 0x7f4804106750 2024-09-13T18:14:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4809000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041a41a0 con 0x7f4804107fb0 2024-09-13T18:14:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4801e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 0x7f480419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:18.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4801400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 0x7f480419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4801e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 0x7f480419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:60996/0 (socket says 172.21.15.7:60996) 2024-09-13T18:14:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4801e00640 1 -- 172.21.15.7:0/1783505391 learned_addr learned my addr 172.21.15.7:0/1783505391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.822+0000 7f4802800640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4804107fb0 0x7f48041a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4801400640 1 -- 172.21.15.7:0/1783505391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4804107fb0 msgr2=0x7f48041a3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4801400640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4804107fb0 0x7f48041a3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4801400640 1 -- 172.21.15.7:0/1783505391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 msgr2=0x7f480419c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:18.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4801400640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 0x7f480419c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4801400640 1 -- 172.21.15.7:0/1783505391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009560 con 0x7f48041075f0 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4801e00640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 0x7f480419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4801400640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 0x7f480419c900 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009230 tx=0x7f47f0005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f47faa00640 1 -- 172.21.15.7:0/1783505391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0004c50 con 0x7f48041075f0 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f47faa00640 1 -- 172.21.15.7:0/1783505391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47f0004db0 con 0x7f48041075f0 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f47faa00640 1 -- 172.21.15.7:0/1783505391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0031ac0 con 0x7f48041075f0 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48041a4420 con 0x7f48041075f0 2024-09-13T18:14:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.823+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48041a4840 con 0x7f48041075f0 2024-09-13T18:14:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.824+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480410d890 con 0x7f48041075f0 2024-09-13T18:14:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.826+0000 7f47faa00640 1 -- 172.21.15.7:0/1783505391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f47f0031c20 con 0x7f48041075f0 2024-09-13T18:14:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.827+0000 7f47faa00640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f47e80a1130 0x7f47e80a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.828+0000 7f47faa00640 1 -- 172.21.15.7:0/1783505391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f47f00ed340 con 0x7f48041075f0 2024-09-13T18:14:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.828+0000 7f4801e00640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f47e80a1130 0x7f47e80a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.828+0000 7f4801e00640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f47e80a1130 0x7f47e80a35f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47f4011550 tx=0x7f47f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:18.832+0000 7f47faa00640 1 -- 172.21.15.7:0/1783505391 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f47f00b6f80 con 0x7f48041075f0 2024-09-13T18:14:19.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.013+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f480402c410 con 0x7f48041075f0 2024-09-13T18:14:19.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.013+0000 7f47faa00640 1 -- 172.21.15.7:0/1783505391 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7f47f00ba5a0 con 0x7f48041075f0 2024-09-13T18:14:19.016 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f47e80a1130 msgr2=0x7f47e80a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f47e80a1130 0x7f47e80a35f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47f4011550 tx=0x7f47f4005f90 comp rx=0 tx=0).stop 2024-09-13T18:14:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 msgr2=0x7f480419c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 0x7f480419c900 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009230 tx=0x7f47f0005620 comp rx=0 tx=0).stop 2024-09-13T18:14:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 shutdown_connections 2024-09-13T18:14:19.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f47e80a1130 0x7f47e80a35f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4804107fb0 0x7f48041a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48041075f0 0x7f480419c900 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 --2- 172.21.15.7:0/1783505391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4804106750 0x7f480419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 >> 172.21.15.7:0/1783505391 conn(0x7f48040756c0 msgr2=0x7f480410aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 shutdown_connections 2024-09-13T18:14:19.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:19.016+0000 7f4809000640 1 -- 172.21.15.7:0/1783505391 wait complete. 2024-09-13T18:14:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:19 smithi007 ceph-mon[30588]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:19 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1783505391' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:14:19.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:19 smithi116 ceph-mon[35109]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:19.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:19 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1783505391' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:14:19.714 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1726251255,"num_in_osds":12,"osd_in_since":1726251236,"num_remapped_pgs":0} 2024-09-13T18:14:19.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:14:19.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:19 smithi067 ceph-mon[35103]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:19.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:19 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1783505391' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:14:20.030 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:14:21.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:21 smithi007 ceph-mon[30588]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:21.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:21 smithi116 ceph-mon[35109]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:21.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 -- 172.21.15.7:0/865519917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c40fed30 msgr2=0x7fc7c40ff110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 --2- 172.21.15.7:0/865519917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c40fed30 0x7fc7c40ff110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009900 tx=0x7fc7b402a470 comp rx=0 tx=0).stop 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 -- 172.21.15.7:0/865519917 shutdown_connections 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 --2- 172.21.15.7:0/865519917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c4104140 0x7fc7c41045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 --2- 172.21.15.7:0/865519917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40ff650 0x7fc7c4103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 --2- 172.21.15.7:0/865519917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c40fed30 0x7fc7c40ff110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 -- 172.21.15.7:0/865519917 >> 172.21.15.7:0/865519917 conn(0x7fc7c40fa980 msgr2=0x7fc7c40fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 -- 172.21.15.7:0/865519917 shutdown_connections 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.977+0000 7fc7ca600640 1 -- 172.21.15.7:0/865519917 wait complete. 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.978+0000 7fc7ca600640 1 Processor -- start 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.978+0000 7fc7ca600640 1 -- start start 2024-09-13T18:14:21.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.978+0000 7fc7ca600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40fed30 0x7fc7c41a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7ca600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40ff650 0x7fc7c41a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7ca600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c4104140 0x7fc7c419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7ca600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c419cd90 con 0x7fc7c4104140 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7ca600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c419cf00 con 0x7fc7c40ff650 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7ca600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c419d0c0 con 0x7fc7c40fed30 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40fed30 0x7fc7c41a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c4104140 0x7fc7c419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40fed30 0x7fc7c41a2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:46398/0 (socket says 172.21.15.7:46398) 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 -- 172.21.15.7:0/1951411043 learned_addr learned my addr 172.21.15.7:0/1951411043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c2a00640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40ff650 0x7fc7c41a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 -- 172.21.15.7:0/1951411043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40ff650 msgr2=0x7fc7c41a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:21.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40ff650 0x7fc7c41a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 -- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c4104140 msgr2=0x7fc7c419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c4104140 0x7fc7c419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3400640 1 -- 172.21.15.7:0/1951411043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4009560 con 0x7fc7c40fed30 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.979+0000 7fc7c3e00640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c4104140 0x7fc7c419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.980+0000 7fc7c3400640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40fed30 0x7fc7c41a2600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4031440 tx=0x7fc7b4003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.980+0000 7fc7bbe00640 1 -- 172.21.15.7:0/1951411043 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4005d50 con 0x7fc7c40fed30 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.980+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c419d340 con 0x7fc7c40fed30 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.980+0000 7fc7bbe00640 1 -- 172.21.15.7:0/1951411043 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7b40054e0 con 0x7fc7c40fed30 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.980+0000 7fc7bbe00640 1 -- 172.21.15.7:0/1951411043 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4031910 con 0x7fc7c40fed30 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.980+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c41a95f0 con 0x7fc7c40fed30 2024-09-13T18:14:21.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.981+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c4069000 con 0x7fc7c40fed30 2024-09-13T18:14:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.983+0000 7fc7bbe00640 1 -- 172.21.15.7:0/1951411043 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fc7b40048a0 con 0x7fc7c40fed30 2024-09-13T18:14:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.984+0000 7fc7bbe00640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7a80a1080 0x7fc7a80a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.984+0000 7fc7bbe00640 1 -- 172.21.15.7:0/1951411043 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc7b40ecd10 con 0x7fc7c40fed30 2024-09-13T18:14:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.985+0000 7fc7c2a00640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7a80a1080 0x7fc7a80a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:21.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.985+0000 7fc7c2a00640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7a80a1080 0x7fc7a80a3540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7c419db60 tx=0x7fc7b000b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:21.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:21.987+0000 7fc7bbe00640 1 -- 172.21.15.7:0/1951411043 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc7b40b6950 con 0x7fc7c40fed30 2024-09-13T18:14:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:21 smithi067 ceph-mon[35103]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:22.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.165+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7c4103b20 con 0x7fc7c40fed30 2024-09-13T18:14:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.167+0000 7fc7bbe00640 1 -- 172.21.15.7:0/1951411043 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18292 (secure 0 0 0) 0x7fc7b40a3e60 con 0x7fc7c40fed30 2024-09-13T18:14:22.170 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:22.170 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:14:17.251749+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:14:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7a80a1080 msgr2=0x7fc7a80a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7a80a1080 0x7fc7a80a3540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7c419db60 tx=0x7fc7b000b2e0 comp rx=0 tx=0).stop 2024-09-13T18:14:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40fed30 msgr2=0x7fc7c41a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40fed30 0x7fc7c41a2600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4031440 tx=0x7fc7b4003d50 comp rx=0 tx=0).stop 2024-09-13T18:14:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 shutdown_connections 2024-09-13T18:14:22.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7a80a1080 0x7fc7a80a3540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7c4104140 0x7fc7c419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7c40ff650 0x7fc7c41a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 --2- 172.21.15.7:0/1951411043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c40fed30 0x7fc7c41a2600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 >> 172.21.15.7:0/1951411043 conn(0x7fc7c40fa980 msgr2=0x7fc7c410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 shutdown_connections 2024-09-13T18:14:22.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:22.169+0000 7fc7ca600640 1 -- 172.21.15.7:0/1951411043 wait complete. 2024-09-13T18:14:22.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:22 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1951411043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:14:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:22 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1951411043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:14:23.023 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:22 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1951411043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:14:23.055 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:14:23.056 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T18:14:23.372 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:14:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:23 smithi007 ceph-mon[30588]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:23.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:23 smithi116 ceph-mon[35109]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:23 smithi067 ceph-mon[35103]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:24.697 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:24 smithi007 ceph-mon[30588]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:24.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:24 smithi116 ceph-mon[35109]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:24 smithi067 ceph-mon[35103]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:25.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.347+0000 7fc800c00640 1 -- 172.21.15.7:0/951439724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc073170 msgr2=0x7fc7fc110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.347+0000 7fc800c00640 1 --2- 172.21.15.7:0/951439724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc073170 0x7fc7fc110850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009860 tx=0x7fc7e402a3d0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.348+0000 7fc800c00640 1 -- 172.21.15.7:0/951439724 shutdown_connections 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.348+0000 7fc800c00640 1 --2- 172.21.15.7:0/951439724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc110d90 0x7fc7fc113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.348+0000 7fc800c00640 1 --2- 172.21.15.7:0/951439724 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc073170 0x7fc7fc110850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.348+0000 7fc800c00640 1 --2- 172.21.15.7:0/951439724 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7fc072850 0x7fc7fc072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.348+0000 7fc800c00640 1 -- 172.21.15.7:0/951439724 >> 172.21.15.7:0/951439724 conn(0x7fc7fc0fbae0 msgr2=0x7fc7fc0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.348+0000 7fc800c00640 1 -- 172.21.15.7:0/951439724 shutdown_connections 2024-09-13T18:14:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.348+0000 7fc800c00640 1 -- 172.21.15.7:0/951439724 wait complete. 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 Processor -- start 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 -- start start 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc072850 0x7fc7fc1a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7fc073170 0x7fc7fc1a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc110d90 0x7fc7fc19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc19ce60 con 0x7fc7fc072850 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc19cfd0 con 0x7fc7fc110d90 2024-09-13T18:14:25.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.349+0000 7fc800c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc19d190 con 0x7fc7fc073170 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc072850 0x7fc7fc1a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc072850 0x7fc7fc1a2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39404/0 (socket says 172.21.15.7:39404) 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 -- 172.21.15.7:0/1339383364 learned_addr learned my addr 172.21.15.7:0/1339383364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f1400640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7fc073170 0x7fc7fc1a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7fa800640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc110d90 0x7fc7fc19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 -- 172.21.15.7:0/1339383364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7fc073170 msgr2=0x7fc7fc1a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7fc073170 0x7fc7fc1a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 -- 172.21.15.7:0/1339383364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc110d90 msgr2=0x7fc7fc19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc110d90 0x7fc7fc19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f9e00640 1 -- 172.21.15.7:0/1339383364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4009900 con 0x7fc7fc072850 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.350+0000 7fc7f1400640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7fc073170 0x7fc7fc1a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.351+0000 7fc7f9e00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc072850 0x7fc7fc1a2600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00e9f0 tx=0x7fc7ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.351+0000 7fc7f3400640 1 -- 172.21.15.7:0/1339383364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec009720 con 0x7fc7fc072850 2024-09-13T18:14:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.351+0000 7fc7f3400640 1 -- 172.21.15.7:0/1339383364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7ec00cd80 con 0x7fc7fc072850 2024-09-13T18:14:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.351+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e4009490 con 0x7fc7fc072850 2024-09-13T18:14:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.351+0000 7fc7f3400640 1 -- 172.21.15.7:0/1339383364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec010430 con 0x7fc7fc072850 2024-09-13T18:14:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.351+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc1a93b0 con 0x7fc7fc072850 2024-09-13T18:14:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.352+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc073f90 con 0x7fc7fc072850 2024-09-13T18:14:25.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.354+0000 7fc7f3400640 1 -- 172.21.15.7:0/1339383364 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fc7ec005020 con 0x7fc7fc072850 2024-09-13T18:14:25.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.355+0000 7fc7f3400640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7e00a1080 0x7fc7e00a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.355+0000 7fc7f3400640 1 -- 172.21.15.7:0/1339383364 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc7ec014070 con 0x7fc7fc072850 2024-09-13T18:14:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.355+0000 7fc7f1400640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7e00a1080 0x7fc7e00a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:25.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.356+0000 7fc7f1400640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7e00a1080 0x7fc7e00a3540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7e402a9c0 tx=0x7fc7e40058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:25.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.359+0000 7fc7f3400640 1 -- 172.21.15.7:0/1339383364 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc7ec0963a0 con 0x7fc7fc072850 2024-09-13T18:14:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.545+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7fc1031f0 con 0x7fc7fc072850 2024-09-13T18:14:25.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.546+0000 7fc7f3400640 1 -- 172.21.15.7:0/1339383364 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7ec0999c0 con 0x7fc7fc072850 2024-09-13T18:14:25.549 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:14:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.548+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7e00a1080 msgr2=0x7fc7e00a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:25.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.548+0000 7fc800c00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7e00a1080 0x7fc7e00a3540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7e402a9c0 tx=0x7fc7e40058b0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.548+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc072850 msgr2=0x7fc7fc1a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.548+0000 7fc800c00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc072850 0x7fc7fc1a2600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00e9f0 tx=0x7fc7ec00edf0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 shutdown_connections 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc7e00a1080 0x7fc7e00a3540 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7fc110d90 0x7fc7fc19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7fc073170 0x7fc7fc1a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 --2- 172.21.15.7:0/1339383364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7fc072850 0x7fc7fc1a2600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 >> 172.21.15.7:0/1339383364 conn(0x7fc7fc0fbae0 msgr2=0x7fc7fc0fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 shutdown_connections 2024-09-13T18:14:25.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:25.549+0000 7fc800c00640 1 -- 172.21.15.7:0/1339383364 wait complete. 2024-09-13T18:14:25.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:25 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1339383364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:14:25.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:25 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1339383364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:14:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:25 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1339383364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.a on smithi007 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.d on smithi007 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.g on smithi007 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.j on smithi007 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.b on smithi067 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.e on smithi067 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.h on smithi067 2024-09-13T18:14:26.351 INFO:tasks.cephadm:Adding mds.k on smithi067 2024-09-13T18:14:26.352 INFO:tasks.cephadm:Adding mds.c on smithi116 2024-09-13T18:14:26.352 INFO:tasks.cephadm:Adding mds.f on smithi116 2024-09-13T18:14:26.352 INFO:tasks.cephadm:Adding mds.i on smithi116 2024-09-13T18:14:26.352 INFO:tasks.cephadm:Adding mds.l on smithi116 2024-09-13T18:14:26.352 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l' 2024-09-13T18:14:26.564 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:14:26.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:26 smithi116 ceph-mon[35109]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:26 smithi067 ceph-mon[35103]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:27.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:26 smithi007 ceph-mon[30588]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 -- 172.21.15.116:0/3070804025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc103240 msgr2=0x7f70dc105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 --2- 172.21.15.116:0/3070804025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc103240 0x7f70dc105630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009900 tx=0x7f70d002a410 comp rx=0 tx=0).stop 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 -- 172.21.15.116:0/3070804025 shutdown_connections 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 --2- 172.21.15.116:0/3070804025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc105b70 0x7f70dc107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 --2- 172.21.15.116:0/3070804025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc103240 0x7f70dc105630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 --2- 172.21.15.116:0/3070804025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70dc100910 0x7f70dc102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 -- 172.21.15.116:0/3070804025 >> 172.21.15.116:0/3070804025 conn(0x7f70dc0fa490 msgr2=0x7f70dc0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 -- 172.21.15.116:0/3070804025 shutdown_connections 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.246+0000 7f70e2217640 1 -- 172.21.15.116:0/3070804025 wait complete. 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 Processor -- start 2024-09-13T18:14:28.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 -- start start 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc100910 0x7f70dc195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70dc103240 0x7f70dc196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc105b70 0x7f70dc19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc19d930 con 0x7f70dc105b70 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc19daa0 con 0x7f70dc103240 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.247+0000 7f70e2217640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc19dc60 con 0x7f70dc100910 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc100910 0x7f70dc195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc100910 0x7f70dc195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56382/0 (socket says 172.21.15.116:56382) 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 -- 172.21.15.116:0/1656315336 learned_addr learned my addr 172.21.15.116:0/1656315336 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70daffd640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70dc103240 0x7f70dc196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70dbfff640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc105b70 0x7f70dc19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 -- 172.21.15.116:0/1656315336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70dc103240 msgr2=0x7f70dc196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:28.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70dc103240 0x7f70dc196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 -- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc105b70 msgr2=0x7f70dc19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc105b70 0x7f70dc19d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 -- 172.21.15.116:0/1656315336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009560 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70dbfff640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc105b70 0x7f70dc19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70db7fe640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc100910 0x7f70dc195e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00b4a0 tx=0x7f70cc00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70d8ff9640 1 -- 172.21.15.116:0/1656315336 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc010610 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70d8ff9640 1 -- 172.21.15.116:0/1656315336 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70cc010c30 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc19df40 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70d8ff9640 1 -- 172.21.15.116:0/1656315336 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc017dd0 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.248+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc19e370 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.249+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc0fbf80 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.250+0000 7f70d8ff9640 1 -- 172.21.15.116:0/1656315336 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f70cc0173f0 con 0x7f70dc100910 2024-09-13T18:14:28.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.251+0000 7f70d8ff9640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f70c40a10b0 0x7f70c40a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:28.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.251+0000 7f70d8ff9640 1 -- 172.21.15.116:0/1656315336 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f70cc0cbb50 con 0x7f70dc100910 2024-09-13T18:14:28.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.252+0000 7f70daffd640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f70c40a10b0 0x7f70c40a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:28.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.252+0000 7f70daffd640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f70c40a10b0 0x7f70c40a3570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70d0006010 tx=0x7f70d00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:28.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.255+0000 7f70d8ff9640 1 -- 172.21.15.116:0/1656315336 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f70cc095780 con 0x7f70dc100910 2024-09-13T18:14:28.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.423+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f70dc02c520 con 0x7f70c40a10b0 2024-09-13T18:14:28.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.432+0000 7f70d8ff9640 1 -- 172.21.15.116:0/1656315336 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f70dc02c520 con 0x7f70c40a10b0 2024-09-13T18:14:28.435 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mds.all update... 2024-09-13T18:14:28.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f70c40a10b0 msgr2=0x7f70c40a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:28.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f70c40a10b0 0x7f70c40a3570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70d0006010 tx=0x7f70d00314a0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc100910 msgr2=0x7f70dc195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:28.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc100910 0x7f70dc195e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00b4a0 tx=0x7f70cc00b960 comp rx=0 tx=0).stop 2024-09-13T18:14:28.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 shutdown_connections 2024-09-13T18:14:28.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f70c40a10b0 0x7f70c40a3570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70dc105b70 0x7f70dc19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70dc103240 0x7f70dc196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 --2- 172.21.15.116:0/1656315336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70dc100910 0x7f70dc195e30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:28.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 >> 172.21.15.116:0/1656315336 conn(0x7f70dc0fa490 msgr2=0x7f70dc101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:28.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 shutdown_connections 2024-09-13T18:14:28.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-13T18:14:28.434+0000 7f70e2217640 1 -- 172.21.15.116:0/1656315336 wait complete. 2024-09-13T18:14:29.059 DEBUG:teuthology.orchestra.run.smithi007:mds.a> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.a.service 2024-09-13T18:14:29.064 DEBUG:teuthology.orchestra.run.smithi007:mds.d> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.d.service 2024-09-13T18:14:29.110 DEBUG:teuthology.orchestra.run.smithi007:mds.g> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.g.service 2024-09-13T18:14:29.154 DEBUG:teuthology.orchestra.run.smithi007:mds.j> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.j.service 2024-09-13T18:14:29.199 DEBUG:teuthology.orchestra.run.smithi067:mds.b> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.b.service 2024-09-13T18:14:29.202 DEBUG:teuthology.orchestra.run.smithi067:mds.e> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.e.service 2024-09-13T18:14:29.245 DEBUG:teuthology.orchestra.run.smithi067:mds.h> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.h.service 2024-09-13T18:14:29.288 DEBUG:teuthology.orchestra.run.smithi067:mds.k> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.k.service 2024-09-13T18:14:29.331 DEBUG:teuthology.orchestra.run.smithi116:mds.c> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.c.service 2024-09-13T18:14:29.334 DEBUG:teuthology.orchestra.run.smithi116:mds.f> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.f.service 2024-09-13T18:14:29.376 DEBUG:teuthology.orchestra.run.smithi116:mds.i> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.i.service 2024-09-13T18:14:29.420 DEBUG:teuthology.orchestra.run.smithi116:mds.l> sudo journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.l.service 2024-09-13T18:14:29.463 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-13T18:14:29.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:14:29.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:14:29.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:29.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:29 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:29.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 -- 172.21.15.7:0/2824518384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed901031d0 msgr2=0x7fed90103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:29.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 --2- 172.21.15.7:0/2824518384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed901031d0 0x7fed90103650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed78009900 tx=0x7fed7802a410 comp rx=0 tx=0).stop 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 -- 172.21.15.7:0/2824518384 shutdown_connections 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 --2- 172.21.15.7:0/2824518384 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed90103b90 0x7fed9010a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 --2- 172.21.15.7:0/2824518384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed901031d0 0x7fed90103650 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 --2- 172.21.15.7:0/2824518384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed90101fe0 0x7fed901023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 -- 172.21.15.7:0/2824518384 >> 172.21.15.7:0/2824518384 conn(0x7fed900fd760 msgr2=0x7fed900ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 -- 172.21.15.7:0/2824518384 shutdown_connections 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.630+0000 7fed97800640 1 -- 172.21.15.7:0/2824518384 wait complete. 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.631+0000 7fed97800640 1 Processor -- start 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.631+0000 7fed97800640 1 -- start start 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed97800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed90101fe0 0x7fed90197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed97800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed901031d0 0x7fed901984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:29.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed97800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed90103b90 0x7fed9019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed97800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9019faa0 con 0x7fed90101fe0 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed97800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9019fc10 con 0x7fed90103b90 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed97800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9019fdd0 con 0x7fed901031d0 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed94e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed90101fe0 0x7fed90197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed901031d0 0x7fed901984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed901031d0 0x7fed901984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:39670/0 (socket says 172.21.15.7:39670) 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 -- 172.21.15.7:0/2312633610 learned_addr learned my addr 172.21.15.7:0/2312633610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed95800640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed90103b90 0x7fed9019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 -- 172.21.15.7:0/2312633610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed90103b90 msgr2=0x7fed9019f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed90103b90 0x7fed9019f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 -- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed90101fe0 msgr2=0x7fed90197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed90101fe0 0x7fed90197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 -- 172.21.15.7:0/2312633610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009840 con 0x7fed901031d0 2024-09-13T18:14:29.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed94e00640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed90101fe0 0x7fed90197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.632+0000 7fed87e00640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed901031d0 0x7fed901984f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed78009a20 tx=0x7fed78005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.633+0000 7fed8e000640 1 -- 172.21.15.7:0/2312633610 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78004b50 con 0x7fed901031d0 2024-09-13T18:14:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.633+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed78009560 con 0x7fed901031d0 2024-09-13T18:14:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.633+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed901a03c0 con 0x7fed901031d0 2024-09-13T18:14:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.633+0000 7fed8e000640 1 -- 172.21.15.7:0/2312633610 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed78004cb0 con 0x7fed901031d0 2024-09-13T18:14:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.633+0000 7fed8e000640 1 -- 172.21.15.7:0/2312633610 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780319c0 con 0x7fed901031d0 2024-09-13T18:14:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.634+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed90109510 con 0x7fed901031d0 2024-09-13T18:14:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.636+0000 7fed8e000640 1 -- 172.21.15.7:0/2312633610 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fed78003b40 con 0x7fed901031d0 2024-09-13T18:14:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.637+0000 7fed8e000640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fed740a1090 0x7fed740a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.637+0000 7fed8e000640 1 -- 172.21.15.7:0/2312633610 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fed780ed0e0 con 0x7fed901031d0 2024-09-13T18:14:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.637+0000 7fed94e00640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fed740a1090 0x7fed740a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:29.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.638+0000 7fed94e00640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fed740a1090 0x7fed740a3550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed90103030 tx=0x7fed80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.641+0000 7fed8e000640 1 -- 172.21.15.7:0/2312633610 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fed780b6c70 con 0x7fed901031d0 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:29.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:29.713 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:29 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:29.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:29.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:29.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:29 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:29.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.821+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed90108f80 con 0x7fed901031d0 2024-09-13T18:14:29.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.822+0000 7fed8e000640 1 -- 172.21.15.7:0/2312633610 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18292 (secure 0 0 0) 0x7fed780ba290 con 0x7fed901031d0 2024-09-13T18:14:29.825 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:29.825 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:14:17.251749+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fed740a1090 msgr2=0x7fed740a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fed740a1090 0x7fed740a3550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed90103030 tx=0x7fed80005f90 comp rx=0 tx=0).stop 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed901031d0 msgr2=0x7fed901984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed901031d0 0x7fed901984f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed78009a20 tx=0x7fed78005620 comp rx=0 tx=0).stop 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 shutdown_connections 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fed740a1090 0x7fed740a3550 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed90103b90 0x7fed9019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed901031d0 0x7fed901984f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 --2- 172.21.15.7:0/2312633610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fed90101fe0 0x7fed90197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:29.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.824+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 >> 172.21.15.7:0/2312633610 conn(0x7fed900fd760 msgr2=0x7fed901066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:29.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.825+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 shutdown_connections 2024-09-13T18:14:29.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:29.825+0000 7fed97800640 1 -- 172.21.15.7:0/2312633610 wait complete. 2024-09-13T18:14:29.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:14:29.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:14:30.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 -- 172.21.15.7:0/3786789926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b4810c360 msgr2=0x7f5b4810e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/3786789926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b4810c360 0x7f5b4810e750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009ca0 tx=0x7f5b4002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 -- 172.21.15.7:0/3786789926 shutdown_connections 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/3786789926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b4810c360 0x7f5b4810e750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/3786789926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48072f10 0x7f5b48073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/3786789926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b480744f0 0x7f5b48072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 -- 172.21.15.7:0/3786789926 >> 172.21.15.7:0/3786789926 conn(0x7f5b480fb4d0 msgr2=0x7f5b480fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 -- 172.21.15.7:0/3786789926 shutdown_connections 2024-09-13T18:14:30.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.004+0000 7f5b4fe00640 1 -- 172.21.15.7:0/3786789926 wait complete. 2024-09-13T18:14:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 Processor -- start 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 -- start start 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b48072f10 0x7f5b4819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b480744f0 0x7f5b4819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4810c360 0x7f5b481a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481a3e60 con 0x7f5b480744f0 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481a3fd0 con 0x7f5b4810c360 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.005+0000 7f5b4fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481a4190 con 0x7f5b48072f10 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b480744f0 0x7f5b4819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b480744f0 0x7f5b4819c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39444/0 (socket says 172.21.15.7:39444) 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 -- 172.21.15.7:0/1730618535 learned_addr learned my addr 172.21.15.7:0/1730618535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4d400640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b48072f10 0x7f5b4819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4de00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4810c360 0x7f5b481a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 -- 172.21.15.7:0/1730618535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b48072f10 msgr2=0x7f5b4819c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b48072f10 0x7f5b4819c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 -- 172.21.15.7:0/1730618535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4810c360 msgr2=0x7f5b481a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4810c360 0x7f5b481a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 -- 172.21.15.7:0/1730618535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009900 con 0x7f5b480744f0 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4de00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4810c360 0x7f5b481a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b4ca00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b480744f0 0x7f5b4819c8b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400e9f0 tx=0x7f5b3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.006+0000 7f5b46000640 1 -- 172.21.15.7:0/1730618535 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34009700 con 0x7f5b480744f0 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.007+0000 7f5b46000640 1 -- 172.21.15.7:0/1730618535 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b3400cd80 con 0x7f5b480744f0 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.007+0000 7f5b46000640 1 -- 172.21.15.7:0/1730618535 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34018860 con 0x7f5b480744f0 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.007+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b481a4470 con 0x7f5b480744f0 2024-09-13T18:14:30.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.007+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b481a4930 con 0x7f5b480744f0 2024-09-13T18:14:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.008+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b48102530 con 0x7f5b480744f0 2024-09-13T18:14:30.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.010+0000 7f5b46000640 1 -- 172.21.15.7:0/1730618535 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f5b340189c0 con 0x7f5b480744f0 2024-09-13T18:14:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.011+0000 7f5b46000640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5b300a1110 0x7f5b300a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.011+0000 7f5b46000640 1 -- 172.21.15.7:0/1730618535 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5b34014070 con 0x7f5b480744f0 2024-09-13T18:14:30.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.011+0000 7f5b4d400640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5b300a1110 0x7f5b300a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.012+0000 7f5b4d400640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5b300a1110 0x7f5b300a35d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c005fd0 tx=0x7f5b3c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:30.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.015+0000 7f5b46000640 1 -- 172.21.15.7:0/1730618535 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b34052e20 con 0x7f5b480744f0 2024-09-13T18:14:30.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.194+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b4802c3e0 con 0x7f5b480744f0 2024-09-13T18:14:30.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.194+0000 7f5b46000640 1 -- 172.21.15.7:0/1730618535 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b340963e0 con 0x7f5b480744f0 2024-09-13T18:14:30.197 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:14:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5b300a1110 msgr2=0x7f5b300a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5b300a1110 0x7f5b300a35d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c005fd0 tx=0x7f5b3c00b390 comp rx=0 tx=0).stop 2024-09-13T18:14:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b480744f0 msgr2=0x7f5b4819c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b480744f0 0x7f5b4819c8b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400e9f0 tx=0x7f5b3400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 shutdown_connections 2024-09-13T18:14:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5b300a1110 0x7f5b300a35d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4810c360 0x7f5b481a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b480744f0 0x7f5b4819c8b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 --2- 172.21.15.7:0/1730618535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b48072f10 0x7f5b4819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.196+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 >> 172.21.15.7:0/1730618535 conn(0x7f5b480fb4d0 msgr2=0x7f5b480ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.197+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 shutdown_connections 2024-09-13T18:14:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.197+0000 7f5b4fe00640 1 -- 172.21.15.7:0/1730618535 wait complete. 2024-09-13T18:14:30.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:30.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 -- 172.21.15.7:0/423378499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b08101fe0 msgr2=0x7f6b081023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 --2- 172.21.15.7:0/423378499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b08101fe0 0x7f6b081023e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009900 tx=0x7f6af802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 -- 172.21.15.7:0/423378499 shutdown_connections 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 --2- 172.21.15.7:0/423378499 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b08103b90 0x7f6b0810a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 --2- 172.21.15.7:0/423378499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b081031d0 0x7f6b08103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 --2- 172.21.15.7:0/423378499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b08101fe0 0x7f6b081023e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 -- 172.21.15.7:0/423378499 >> 172.21.15.7:0/423378499 conn(0x7f6b080fd760 msgr2=0x7f6b080ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 -- 172.21.15.7:0/423378499 shutdown_connections 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.370+0000 7f6b0e800640 1 -- 172.21.15.7:0/423378499 wait complete. 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 Processor -- start 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 -- start start 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b08101fe0 0x7f6b08198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b081031d0 0x7f6b08198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b08103b90 0x7f6b0819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0819fb20 con 0x7f6b081031d0 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0819fc90 con 0x7f6b08103b90 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.371+0000 7f6b0e800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0819fe50 con 0x7f6b08101fe0 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b081031d0 0x7f6b08198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b081031d0 0x7f6b08198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39472/0 (socket says 172.21.15.7:39472) 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 -- 172.21.15.7:0/3465421478 learned_addr learned my addr 172.21.15.7:0/3465421478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6b07400640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b08101fe0 0x7f6b08198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6b07e00640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b08103b90 0x7f6b0819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 -- 172.21.15.7:0/3465421478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b08101fe0 msgr2=0x7f6b08198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b08101fe0 0x7f6b08198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 -- 172.21.15.7:0/3465421478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b08103b90 msgr2=0x7f6b0819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b08103b90 0x7f6b0819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 -- 172.21.15.7:0/3465421478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af8009560 con 0x7f6b081031d0 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6affe00640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b081031d0 0x7f6b08198570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6af000d770 tx=0x7f6af000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6b04c00640 1 -- 172.21.15.7:0/3465421478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0009c30 con 0x7f6b081031d0 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.372+0000 7f6b04c00640 1 -- 172.21.15.7:0/3465421478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6af000de80 con 0x7f6b081031d0 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.373+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b081a0130 con 0x7f6b081031d0 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.373+0000 7f6b04c00640 1 -- 172.21.15.7:0/3465421478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0004de0 con 0x7f6b081031d0 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.373+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b081a05f0 con 0x7f6b081031d0 2024-09-13T18:14:30.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.374+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b081094c0 con 0x7f6b081031d0 2024-09-13T18:14:30.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.376+0000 7f6b04c00640 1 -- 172.21.15.7:0/3465421478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f6af0004f40 con 0x7f6b081031d0 2024-09-13T18:14:30.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.378+0000 7f6b04c00640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6aec0a1090 0x7f6aec0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:30.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.379+0000 7f6b04c00640 1 -- 172.21.15.7:0/3465421478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6af00cbeb0 con 0x7f6b081031d0 2024-09-13T18:14:30.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.379+0000 7f6b07400640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6aec0a1090 0x7f6aec0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:30.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.379+0000 7f6b07400640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6aec0a1090 0x7f6aec0a3550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6af8031500 tx=0x7f6af8005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:30.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.382+0000 7f6b04c00640 1 -- 172.21.15.7:0/3465421478 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6af0095af0 con 0x7f6b081031d0 2024-09-13T18:14:30.518 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:30 smithi116 ceph-mon[35109]: Deploying daemon mds.l on smithi116 2024-09-13T18:14:30.518 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:30 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2312633610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:14:30.518 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:30 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1730618535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:14:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:30 smithi007 ceph-mon[30588]: Deploying daemon mds.l on smithi116 2024-09-13T18:14:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:30 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2312633610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:14:30.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:30 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1730618535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:14:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.602+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b0810d8f0 con 0x7f6b081031d0 2024-09-13T18:14:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.602+0000 7f6b04c00640 1 -- 172.21.15.7:0/3465421478 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f6af0099110 con 0x7f6b081031d0 2024-09-13T18:14:30.604 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:30.605 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-13T18:14:30.605 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 1 2024-09-13T18:14:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6aec0a1090 msgr2=0x7f6aec0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6aec0a1090 0x7f6aec0a3550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6af8031500 tx=0x7f6af8005780 comp rx=0 tx=0).stop 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b081031d0 msgr2=0x7f6b08198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b081031d0 0x7f6b08198570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6af000d770 tx=0x7f6af000dc30 comp rx=0 tx=0).stop 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 shutdown_connections 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6aec0a1090 0x7f6aec0a3550 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b08103b90 0x7f6b0819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b081031d0 0x7f6b08198570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 --2- 172.21.15.7:0/3465421478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b08101fe0 0x7f6b08198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 >> 172.21.15.7:0/3465421478 conn(0x7f6b080fd760 msgr2=0x7f6b08106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 shutdown_connections 2024-09-13T18:14:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:30.604+0000 7f6b0e800640 1 -- 172.21.15.7:0/3465421478 wait complete. 2024-09-13T18:14:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:30 smithi067 ceph-mon[35103]: Deploying daemon mds.l on smithi116 2024-09-13T18:14:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:30 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2312633610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:14:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:30 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1730618535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:14:30.918 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:30 smithi116 systemd[1]: Starting Ceph mds.l for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:31.174 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:30 smithi116 podman[65255]: 2024-09-13 18:14:30.818281688 +0000 UTC m=+0.015191216 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:31.174 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:30 smithi116 podman[65255]: 2024-09-13 18:14:30.944991854 +0000 UTC m=+0.141901362 container create 8ea9a734e015395864357544df7bce2ea095defeec2456326e7df143e16d5e5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T18:14:31.174 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:31 smithi116 podman[65255]: 2024-09-13 18:14:31.172483993 +0000 UTC m=+0.369393507 container init 8ea9a734e015395864357544df7bce2ea095defeec2456326e7df143e16d5e5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:14:31.444 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:31 smithi116 podman[65255]: 2024-09-13 18:14:31.175499625 +0000 UTC m=+0.372409136 container start 8ea9a734e015395864357544df7bce2ea095defeec2456326e7df143e16d5e5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T18:14:31.445 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mds[65274]: -- 172.21.15.116:0/319547865 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ad84c38d00 con 0x55ad84c0d000 2024-09-13T18:14:31.445 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l[65270]: starting mds.l at 2024-09-13T18:14:31.445 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:31 smithi116 bash[65255]: 8ea9a734e015395864357544df7bce2ea095defeec2456326e7df143e16d5e5c 2024-09-13T18:14:31.445 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:14:31 smithi116 systemd[1]: Started Ceph mds.l for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:31.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3465421478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6832/3628414330,v1:172.21.15.116:6833/3628414330] up:boot 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: fsmap 1 up:standby 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:31.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:31.723 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:31.723 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3465421478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:31.723 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6832/3628414330,v1:172.21.15.116:6833/3628414330] up:boot 2024-09-13T18:14:31.723 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: fsmap 1 up:standby 2024-09-13T18:14:31.723 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:14:31.723 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.724 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.724 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.724 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:31.724 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:31.724 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3465421478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6832/3628414330,v1:172.21.15.116:6833/3628414330] up:boot 2024-09-13T18:14:31.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: fsmap 1 up:standby 2024-09-13T18:14:31.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:14:31.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:31.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:31.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:31.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:32.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:32.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:32 smithi116 ceph-mon[35109]: Deploying daemon mds.k on smithi067 2024-09-13T18:14:32.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:32 smithi067 ceph-mon[35103]: Deploying daemon mds.k on smithi067 2024-09-13T18:14:32.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:32 smithi007 ceph-mon[30588]: Deploying daemon mds.k on smithi067 2024-09-13T18:14:32.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 -- 172.21.15.7:0/2188395278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d0101e00 msgr2=0x7f36d0102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 --2- 172.21.15.7:0/2188395278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d0101e00 0x7f36d0102200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009ca0 tx=0x7f36c002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 -- 172.21.15.7:0/2188395278 shutdown_connections 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 --2- 172.21.15.7:0/2188395278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36d01039b0 0x7f36d010a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 --2- 172.21.15.7:0/2188395278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d0102ff0 0x7f36d0103470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 --2- 172.21.15.7:0/2188395278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d0101e00 0x7f36d0102200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 -- 172.21.15.7:0/2188395278 >> 172.21.15.7:0/2188395278 conn(0x7f36d00fd580 msgr2=0x7f36d00ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 -- 172.21.15.7:0/2188395278 shutdown_connections 2024-09-13T18:14:32.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.789+0000 7f36cfe00640 1 -- 172.21.15.7:0/2188395278 wait complete. 2024-09-13T18:14:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 Processor -- start 2024-09-13T18:14:32.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 -- start start 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d0101e00 0x7f36d0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36d0102ff0 0x7f36d01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d01039b0 0x7f36d019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d019f920 con 0x7f36d01039b0 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d019fa90 con 0x7f36d0102ff0 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cfe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d019fc50 con 0x7f36d0101e00 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d01039b0 0x7f36d019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.790+0000 7f36cea00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d0101e00 0x7f36d0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d01039b0 0x7f36d019f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39486/0 (socket says 172.21.15.7:39486) 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 -- 172.21.15.7:0/1694792973 learned_addr learned my addr 172.21.15.7:0/1694792973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36c6000640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36d0102ff0 0x7f36d01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 -- 172.21.15.7:0/1694792973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d0101e00 msgr2=0x7f36d0197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d0101e00 0x7f36d0197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 -- 172.21.15.7:0/1694792973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36d0102ff0 msgr2=0x7f36d01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36d0102ff0 0x7f36d01983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 -- 172.21.15.7:0/1694792973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0009900 con 0x7f36d01039b0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cf400640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d01039b0 0x7f36d019f3e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36c800d950 tx=0x7f36c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36c7e00640 1 -- 172.21.15.7:0/1694792973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8009a30 con 0x7f36d01039b0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36c7e00640 1 -- 172.21.15.7:0/1694792973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36c8009b90 con 0x7f36d01039b0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36c7e00640 1 -- 172.21.15.7:0/1694792973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8003c00 con 0x7f36d01039b0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.791+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d019ff30 con 0x7f36d01039b0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.792+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d01a0360 con 0x7f36d01039b0 2024-09-13T18:14:32.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.793+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d0109350 con 0x7f36d01039b0 2024-09-13T18:14:32.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.795+0000 7f36c7e00640 1 -- 172.21.15.7:0/1694792973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f36c8009d00 con 0x7f36d01039b0 2024-09-13T18:14:32.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.796+0000 7f36c7e00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36b40a1110 0x7f36b40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:32.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.796+0000 7f36c7e00640 1 -- 172.21.15.7:0/1694792973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f36c80cc190 con 0x7f36d01039b0 2024-09-13T18:14:32.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.796+0000 7f36cea00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36b40a1110 0x7f36b40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:32.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.797+0000 7f36cea00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36b40a1110 0x7f36b40a35d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36c0000f80 tx=0x7f36c00093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:32.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:32.799+0000 7f36c7e00640 1 -- 172.21.15.7:0/1694792973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f36c8095da0 con 0x7f36d01039b0 2024-09-13T18:14:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.014+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36d010d960 con 0x7f36d01039b0 2024-09-13T18:14:33.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.014+0000 7f36c7e00640 1 -- 172.21.15.7:0/1694792973 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f36c80993c0 con 0x7f36d01039b0 2024-09-13T18:14:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:33.017 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:14:33.017 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36b40a1110 msgr2=0x7f36b40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36b40a1110 0x7f36b40a35d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36c0000f80 tx=0x7f36c00093a0 comp rx=0 tx=0).stop 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d01039b0 msgr2=0x7f36d019f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d01039b0 0x7f36d019f3e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36c800d950 tx=0x7f36c800de10 comp rx=0 tx=0).stop 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 shutdown_connections 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36b40a1110 0x7f36b40a35d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36d01039b0 0x7f36d019f3e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36d0102ff0 0x7f36d01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:33.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 --2- 172.21.15.7:0/1694792973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36d0101e00 0x7f36d0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.016+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 >> 172.21.15.7:0/1694792973 conn(0x7f36d00fd580 msgr2=0x7f36d0106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.017+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 shutdown_connections 2024-09-13T18:14:33.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:33.017+0000 7f36cfe00640 1 -- 172.21.15.7:0/1694792973 wait complete. 2024-09-13T18:14:33.451 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 systemd[1]: Starting Ceph mds.k for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:33 smithi116 ceph-mon[35109]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:33.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:33 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1694792973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:33.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:33 smithi067 ceph-mon[35103]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:33.745 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:33 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1694792973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:33.746 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 podman[64535]: 2024-09-13 18:14:33.413944474 +0000 UTC m=+0.016146914 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:33.746 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 podman[64535]: 2024-09-13 18:14:33.537157756 +0000 UTC m=+0.139360188 container create b013519ee676a2018ec714db006200140bf40862650a10c0fd1259cd645c5edf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T18:14:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:33 smithi007 ceph-mon[30588]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:33 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1694792973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:33.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 podman[64535]: 2024-09-13 18:14:33.756115922 +0000 UTC m=+0.358318354 container init b013519ee676a2018ec714db006200140bf40862650a10c0fd1259cd645c5edf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True) 2024-09-13T18:14:33.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 podman[64535]: 2024-09-13 18:14:33.75917821 +0000 UTC m=+0.361380644 container start b013519ee676a2018ec714db006200140bf40862650a10c0fd1259cd645c5edf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T18:14:33.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 ceph-mds[64554]: -- 172.21.15.67:0/974446241 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556513604d00 con 0x5565135d9000 2024-09-13T18:14:33.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k[64550]: starting mds.k at 2024-09-13T18:14:33.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 bash[64535]: b013519ee676a2018ec714db006200140bf40862650a10c0fd1259cd645c5edf 2024-09-13T18:14:33.998 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:14:33 smithi067 systemd[1]: Started Ceph mds.k for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:35.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: Deploying daemon mds.j on smithi007 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6832/344470719,v1:172.21.15.67:6833/344470719] up:boot 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: fsmap 2 up:standby 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:14:35.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:34 smithi007 ceph-mon[30588]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 -- 172.21.15.7:0/1088725902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de41039b0 msgr2=0x7f1de410a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 --2- 172.21.15.7:0/1088725902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de41039b0 0x7f1de410a240 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009ca0 tx=0x7f1ddc02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 -- 172.21.15.7:0/1088725902 shutdown_connections 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 --2- 172.21.15.7:0/1088725902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de41039b0 0x7f1de410a240 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 --2- 172.21.15.7:0/1088725902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4102ff0 0x7f1de4103470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 --2- 172.21.15.7:0/1088725902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de4101e00 0x7f1de4102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 -- 172.21.15.7:0/1088725902 >> 172.21.15.7:0/1088725902 conn(0x7f1de40fd580 msgr2=0x7f1de40ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 -- 172.21.15.7:0/1088725902 shutdown_connections 2024-09-13T18:14:35.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.199+0000 7f1de9800640 1 -- 172.21.15.7:0/1088725902 wait complete. 2024-09-13T18:14:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.200+0000 7f1de9800640 1 Processor -- start 2024-09-13T18:14:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.200+0000 7f1de9800640 1 -- start start 2024-09-13T18:14:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de9800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4101e00 0x7f1de4197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de4102ff0 0x7f1de41982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de41039b0 0x7f1de419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de9800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de419f880 con 0x7f1de4102ff0 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de9800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de419f9f0 con 0x7f1de41039b0 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de9800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de419fbb0 con 0x7f1de4101e00 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1ddbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de4102ff0 0x7f1de41982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4101e00 0x7f1de4197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4101e00 0x7f1de4197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:55850/0 (socket says 172.21.15.7:55850) 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 -- 172.21.15.7:0/3117239013 learned_addr learned my addr 172.21.15.7:0/3117239013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de8e00640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de41039b0 0x7f1de419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 -- 172.21.15.7:0/3117239013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de41039b0 msgr2=0x7f1de419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de41039b0 0x7f1de419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 -- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de4102ff0 msgr2=0x7f1de41982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de4102ff0 0x7f1de41982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1de3e00640 1 -- 172.21.15.7:0/3117239013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc009900 con 0x7f1de4101e00 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.201+0000 7f1ddbe00640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de4102ff0 0x7f1de41982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.202+0000 7f1de3e00640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4101e00 0x7f1de4197da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400e9c0 tx=0x7f1dd400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.202+0000 7f1de1600640 1 -- 172.21.15.7:0/3117239013 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4009700 con 0x7f1de4101e00 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.202+0000 7f1de1600640 1 -- 172.21.15.7:0/3117239013 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1dd40044e0 con 0x7f1de4101e00 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.202+0000 7f1de1600640 1 -- 172.21.15.7:0/3117239013 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4010430 con 0x7f1de4101e00 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.202+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de419fe90 con 0x7f1de4101e00 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.202+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de41a02b0 con 0x7f1de4101e00 2024-09-13T18:14:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.203+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de41092e0 con 0x7f1de4101e00 2024-09-13T18:14:35.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.205+0000 7f1de1600640 1 -- 172.21.15.7:0/3117239013 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f1dd4003f60 con 0x7f1de4101e00 2024-09-13T18:14:35.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.207+0000 7f1de1600640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1dc80a1110 0x7f1dc80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:35.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.207+0000 7f1de1600640 1 -- 172.21.15.7:0/3117239013 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1dd4014070 con 0x7f1de4101e00 2024-09-13T18:14:35.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.207+0000 7f1ddbe00640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1dc80a1110 0x7f1dc80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:35.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.207+0000 7f1ddbe00640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1dc80a1110 0x7f1dc80a35d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009fc0 tx=0x7f1dcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:35.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: Deploying daemon mds.j on smithi007 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6832/344470719,v1:172.21.15.67:6833/344470719] up:boot 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: fsmap 2 up:standby 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:14:35.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:34 smithi116 ceph-mon[35109]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:35.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.209+0000 7f1de1600640 1 -- 172.21.15.7:0/3117239013 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1dd4096ae0 con 0x7f1de4101e00 2024-09-13T18:14:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:35.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:35.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:35.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:35.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: Deploying daemon mds.j on smithi007 2024-09-13T18:14:35.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6832/344470719,v1:172.21.15.67:6833/344470719] up:boot 2024-09-13T18:14:35.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: fsmap 2 up:standby 2024-09-13T18:14:35.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:14:35.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:34 smithi067 ceph-mon[35103]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:35.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.424+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1de410d950 con 0x7f1de4101e00 2024-09-13T18:14:35.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.424+0000 7f1de1600640 1 -- 172.21.15.7:0/3117239013 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2014 (secure 0 0 0) 0x7f1dd4098a10 con 0x7f1de4101e00 2024-09-13T18:14:35.427 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:35.427 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:14:35.427 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2024-09-13T18:14:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.426+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1dc80a1110 msgr2=0x7f1dc80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.426+0000 7f1de9800640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1dc80a1110 0x7f1dc80a35d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009fc0 tx=0x7f1dcc005f90 comp rx=0 tx=0).stop 2024-09-13T18:14:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.426+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4101e00 msgr2=0x7f1de4197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.426+0000 7f1de9800640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4101e00 0x7f1de4197da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400e9c0 tx=0x7f1dd400ee80 comp rx=0 tx=0).stop 2024-09-13T18:14:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 shutdown_connections 2024-09-13T18:14:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1dc80a1110 0x7f1dc80a35d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1de41039b0 0x7f1de419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1de4102ff0 0x7f1de41982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 --2- 172.21.15.7:0/3117239013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1de4101e00 0x7f1de4197da0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:35.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 >> 172.21.15.7:0/3117239013 conn(0x7f1de40fd580 msgr2=0x7f1de41064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:35.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 shutdown_connections 2024-09-13T18:14:35.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:35.427+0000 7f1de9800640 1 -- 172.21.15.7:0/3117239013 wait complete. 2024-09-13T18:14:36.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:35 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3117239013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:35 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3117239013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:36.288 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:35 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3117239013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:36.865 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:36 smithi007 systemd[1]: Starting Ceph mds.j for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:37.138 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:36 smithi007 ceph-mon[30588]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:37.138 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:36 smithi007 podman[70223]: 2024-09-13 18:14:36.773955696 +0000 UTC m=+0.027761071 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:37.138 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:36 smithi007 podman[70223]: 2024-09-13 18:14:36.872242277 +0000 UTC m=+0.126047682 container create ad82d47b1236d073848d0be9848c093b127b4bf9fbe72e4bd7e9c93575a83126 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T18:14:37.138 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:37 smithi007 podman[70223]: 2024-09-13 18:14:37.091399783 +0000 UTC m=+0.345205159 container init ad82d47b1236d073848d0be9848c093b127b4bf9fbe72e4bd7e9c93575a83126 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T18:14:37.138 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:37 smithi007 podman[70223]: 2024-09-13 18:14:37.097619923 +0000 UTC m=+0.351425296 container start ad82d47b1236d073848d0be9848c093b127b4bf9fbe72e4bd7e9c93575a83126 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2) 2024-09-13T18:14:37.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:36 smithi116 ceph-mon[35109]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:36 smithi067 ceph-mon[35103]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:37.447 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:37.497 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:37 smithi007 ceph-mds[70242]: -- 172.21.15.7:0/3835144297 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a59aeead00 con 0x55a59aebe800 2024-09-13T18:14:37.497 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j[70238]: starting mds.j at 2024-09-13T18:14:37.497 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:37 smithi007 bash[70223]: ad82d47b1236d073848d0be9848c093b127b4bf9fbe72e4bd7e9c93575a83126 2024-09-13T18:14:37.497 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:14:37 smithi007 systemd[1]: Started Ceph mds.j for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:37.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.611+0000 7fc2d1c00640 1 -- 172.21.15.7:0/296519472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc1031f0 msgr2=0x7fc2cc103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/296519472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc1031f0 0x7fc2cc103670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009900 tx=0x7fc2b802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 -- 172.21.15.7:0/296519472 shutdown_connections 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/296519472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2cc103bb0 0x7fc2cc10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/296519472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc1031f0 0x7fc2cc103670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/296519472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc102000 0x7fc2cc102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 -- 172.21.15.7:0/296519472 >> 172.21.15.7:0/296519472 conn(0x7fc2cc0fd760 msgr2=0x7fc2cc0ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 -- 172.21.15.7:0/296519472 shutdown_connections 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.612+0000 7fc2d1c00640 1 -- 172.21.15.7:0/296519472 wait complete. 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 Processor -- start 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 -- start start 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc102000 0x7fc2cc197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:37.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc1031f0 0x7fc2cc198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2cc103bb0 0x7fc2cc19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc19fad0 con 0x7fc2cc1031f0 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc19fc40 con 0x7fc2cc102000 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2d1c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc19fe00 con 0x7fc2cc103bb0 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2caa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc102000 0x7fc2cc197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2ca000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc1031f0 0x7fc2cc198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2caa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc102000 0x7fc2cc197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55664/0 (socket says 172.21.15.7:55664) 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2caa00640 1 -- 172.21.15.7:0/1286743484 learned_addr learned my addr 172.21.15.7:0/1286743484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.613+0000 7fc2cb400640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2cc103bb0 0x7fc2cc19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2caa00640 1 -- 172.21.15.7:0/1286743484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2cc103bb0 msgr2=0x7fc2cc19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2caa00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2cc103bb0 0x7fc2cc19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2caa00640 1 -- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc1031f0 msgr2=0x7fc2cc198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2caa00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc1031f0 0x7fc2cc198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2caa00640 1 -- 172.21.15.7:0/1286743484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8009560 con 0x7fc2cc102000 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2caa00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc102000 0x7fc2cc197fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00e9c0 tx=0x7fc2bc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2c3400640 1 -- 172.21.15.7:0/1286743484 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc009700 con 0x7fc2cc102000 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2c3400640 1 -- 172.21.15.7:0/1286743484 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2bc0044e0 con 0x7fc2cc102000 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc1a00e0 con 0x7fc2cc102000 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2c3400640 1 -- 172.21.15.7:0/1286743484 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc010430 con 0x7fc2cc102000 2024-09-13T18:14:37.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.614+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc1a0610 con 0x7fc2cc102000 2024-09-13T18:14:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.615+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc109490 con 0x7fc2cc102000 2024-09-13T18:14:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.617+0000 7fc2c3400640 1 -- 172.21.15.7:0/1286743484 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fc2bc003f60 con 0x7fc2cc102000 2024-09-13T18:14:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.618+0000 7fc2c3400640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2b00a1110 0x7fc2b00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.618+0000 7fc2c3400640 1 -- 172.21.15.7:0/1286743484 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc2bc014070 con 0x7fc2cc102000 2024-09-13T18:14:37.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.619+0000 7fc2ca000640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2b00a1110 0x7fc2b00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:37.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.619+0000 7fc2ca000640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2b00a1110 0x7fc2b00a35d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802a9e0 tx=0x7fc2b80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:37.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.622+0000 7fc2c3400640 1 -- 172.21.15.7:0/1286743484 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2bc096430 con 0x7fc2cc102000 2024-09-13T18:14:37.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.857+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2cc10d8b0 con 0x7fc2cc102000 2024-09-13T18:14:37.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.858+0000 7fc2c3400640 1 -- 172.21.15.7:0/1286743484 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2014 (secure 0 0 0) 0x7fc2cc10d8b0 con 0x7fc2cc102000 2024-09-13T18:14:37.860 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:37.860 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:14:37.861 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2024-09-13T18:14:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2b00a1110 msgr2=0x7fc2b00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2b00a1110 0x7fc2b00a35d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802a9e0 tx=0x7fc2b80314a0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc102000 msgr2=0x7fc2cc197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:37.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc102000 0x7fc2cc197fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00e9c0 tx=0x7fc2bc00ee80 comp rx=0 tx=0).stop 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 shutdown_connections 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc2b00a1110 0x7fc2b00a35d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2cc103bb0 0x7fc2cc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2cc1031f0 0x7fc2cc198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 --2- 172.21.15.7:0/1286743484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2cc102000 0x7fc2cc197fe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 >> 172.21.15.7:0/1286743484 conn(0x7fc2cc0fd760 msgr2=0x7fc2cc106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 shutdown_connections 2024-09-13T18:14:37.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:37.860+0000 7fc2d1c00640 1 -- 172.21.15.7:0/1286743484 wait complete. 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: Deploying daemon mds.d on smithi007 2024-09-13T18:14:38.536 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1286743484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:38.537 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.7:6834/379477361,v1:172.21.15.7:6835/379477361] up:boot 2024-09-13T18:14:38.537 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: fsmap 3 up:standby 2024-09-13T18:14:38.537 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:14:38.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:38.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: Deploying daemon mds.d on smithi007 2024-09-13T18:14:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1286743484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.7:6834/379477361,v1:172.21.15.7:6835/379477361] up:boot 2024-09-13T18:14:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: fsmap 3 up:standby 2024-09-13T18:14:38.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:14:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: Deploying daemon mds.d on smithi007 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1286743484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.7:6834/379477361,v1:172.21.15.7:6835/379477361] up:boot 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: fsmap 3 up:standby 2024-09-13T18:14:38.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:14:39.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:39 smithi007 ceph-mon[30588]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:39.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:39 smithi116 ceph-mon[35109]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:39.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:39 smithi067 ceph-mon[35103]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:39.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:40.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 -- 172.21.15.7:0/3724325411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec103b90 msgr2=0x7f7eec10a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 --2- 172.21.15.7:0/3724325411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec103b90 0x7f7eec10a420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009ca0 tx=0x7f7ee402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 -- 172.21.15.7:0/3724325411 shutdown_connections 2024-09-13T18:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 --2- 172.21.15.7:0/3724325411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec103b90 0x7f7eec10a420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 --2- 172.21.15.7:0/3724325411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec1031d0 0x7f7eec103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 --2- 172.21.15.7:0/3724325411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eec101fe0 0x7f7eec1023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 -- 172.21.15.7:0/3724325411 >> 172.21.15.7:0/3724325411 conn(0x7f7eec0fd760 msgr2=0x7f7eec0ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:40.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 -- 172.21.15.7:0/3724325411 shutdown_connections 2024-09-13T18:14:40.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.049+0000 7f7ef1200640 1 -- 172.21.15.7:0/3724325411 wait complete. 2024-09-13T18:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 Processor -- start 2024-09-13T18:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 -- start start 2024-09-13T18:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec101fe0 0x7f7eec197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec1031d0 0x7f7eec1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eec103b90 0x7f7eec19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:40.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec19fa50 con 0x7f7eec1031d0 2024-09-13T18:14:40.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec19fbc0 con 0x7f7eec103b90 2024-09-13T18:14:40.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ef1200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec19fd80 con 0x7f7eec101fe0 2024-09-13T18:14:40.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ee1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec1031d0 0x7f7eec1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:40.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ee9e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec101fe0 0x7f7eec197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:40.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7eea800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eec103b90 0x7f7eec19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:40.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ee9e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec101fe0 0x7f7eec197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:55902/0 (socket says 172.21.15.7:55902) 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.050+0000 7f7ee9e00640 1 -- 172.21.15.7:0/1297450820 learned_addr learned my addr 172.21.15.7:0/1297450820 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee9e00640 1 -- 172.21.15.7:0/1297450820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eec103b90 msgr2=0x7f7eec19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee9e00640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eec103b90 0x7f7eec19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee9e00640 1 -- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec1031d0 msgr2=0x7f7eec1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee9e00640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec1031d0 0x7f7eec1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee9e00640 1 -- 172.21.15.7:0/1297450820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc009490 con 0x7f7eec101fe0 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee1400640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec1031d0 0x7f7eec1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee9e00640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec101fe0 0x7f7eec197f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e9c0 tx=0x7f7edc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee3400640 1 -- 172.21.15.7:0/1297450820 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00cde0 con 0x7f7eec101fe0 2024-09-13T18:14:40.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee3400640 1 -- 172.21.15.7:0/1297450820 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7edc0108f0 con 0x7f7eec101fe0 2024-09-13T18:14:40.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee4009900 con 0x7f7eec101fe0 2024-09-13T18:14:40.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ee3400640 1 -- 172.21.15.7:0/1297450820 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0188c0 con 0x7f7eec101fe0 2024-09-13T18:14:40.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.051+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec1a03e0 con 0x7f7eec101fe0 2024-09-13T18:14:40.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.052+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec109440 con 0x7f7eec101fe0 2024-09-13T18:14:40.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.054+0000 7f7ee3400640 1 -- 172.21.15.7:0/1297450820 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f7edc010a60 con 0x7f7eec101fe0 2024-09-13T18:14:40.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.056+0000 7f7ee3400640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7ed00a1090 0x7f7ed00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:40.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.056+0000 7f7ee3400640 1 -- 172.21.15.7:0/1297450820 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7edc014070 con 0x7f7eec101fe0 2024-09-13T18:14:40.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.056+0000 7f7ee1400640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7ed00a1090 0x7f7ed00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:40.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.056+0000 7f7ee1400640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7ed00a1090 0x7f7ed00a3550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7eec199470 tx=0x7f7ed4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:40.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.058+0000 7f7ee3400640 1 -- 172.21.15.7:0/1297450820 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7edc096c30 con 0x7f7eec101fe0 2024-09-13T18:14:40.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.283+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eec10d8a0 con 0x7f7eec101fe0 2024-09-13T18:14:40.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.283+0000 7f7ee3400640 1 -- 172.21.15.7:0/1297450820 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2765 (secure 0 0 0) 0x7f7edc09a250 con 0x7f7eec101fe0 2024-09-13T18:14:40.286 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:40.286 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[]} 2024-09-13T18:14:40.286 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 4 2024-09-13T18:14:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7ed00a1090 msgr2=0x7f7ed00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7ed00a1090 0x7f7ed00a3550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7eec199470 tx=0x7f7ed4005f90 comp rx=0 tx=0).stop 2024-09-13T18:14:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec101fe0 msgr2=0x7f7eec197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec101fe0 0x7f7eec197f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00e9c0 tx=0x7f7edc00ee80 comp rx=0 tx=0).stop 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 shutdown_connections 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7ed00a1090 0x7f7ed00a3550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7eec103b90 0x7f7eec19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7eec1031d0 0x7f7eec1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 --2- 172.21.15.7:0/1297450820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7eec101fe0 0x7f7eec197f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 >> 172.21.15.7:0/1297450820 conn(0x7f7eec0fd760 msgr2=0x7f7eec106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 shutdown_connections 2024-09-13T18:14:40.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:40.286+0000 7f7ef1200640 1 -- 172.21.15.7:0/1297450820 wait complete. 2024-09-13T18:14:40.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:40 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1297450820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:40.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:40 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1297450820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:40.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:40 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1297450820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:40.791 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:14:40 smithi007 systemd[1]: Started Ceph mds.d for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:41.681 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:41 smithi067 ceph-mon[35103]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:41.682 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.682 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.682 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.682 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:41.682 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:41.682 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:41.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:41 smithi116 ceph-mon[35109]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:41.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:41 smithi007 ceph-mon[30588]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:42.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 -- 172.21.15.7:0/2072342743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 msgr2=0x7f0528101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 --2- 172.21.15.7:0/2072342743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 0x7f0528101440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0510009900 tx=0x7f051002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 -- 172.21.15.7:0/2072342743 shutdown_connections 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 --2- 172.21.15.7:0/2072342743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528101980 0x7f0528108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 --2- 172.21.15.7:0/2072342743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 0x7f0528101440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 --2- 172.21.15.7:0/2072342743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 0x7f05281001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 -- 172.21.15.7:0/2072342743 >> 172.21.15.7:0/2072342743 conn(0x7f05280fb590 msgr2=0x7f05280fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 -- 172.21.15.7:0/2072342743 shutdown_connections 2024-09-13T18:14:42.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.472+0000 7f052d600640 1 -- 172.21.15.7:0/2072342743 wait complete. 2024-09-13T18:14:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.473+0000 7f052d600640 1 Processor -- start 2024-09-13T18:14:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.473+0000 7f052d600640 1 -- start start 2024-09-13T18:14:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.473+0000 7f052d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 0x7f0528198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:42.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.473+0000 7f052d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 0x7f0528198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f052d600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528101980 0x7f052819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f052d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052819fb40 con 0x7f05280ffdd0 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f052d600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052819fcb0 con 0x7f0528100fc0 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f052d600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052819fe70 con 0x7f0528101980 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 0x7f0528198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 0x7f0528198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57126/0 (socket says 172.21.15.7:57126) 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f051fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 0x7f0528198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 -- 172.21.15.7:0/3150360061 learned_addr learned my addr 172.21.15.7:0/3150360061 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0527400640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528101980 0x7f052819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 -- 172.21.15.7:0/3150360061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528101980 msgr2=0x7f052819f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528101980 0x7f052819f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 -- 172.21.15.7:0/3150360061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 msgr2=0x7f0528198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 0x7f0528198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 -- 172.21.15.7:0/3150360061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0510009560 con 0x7f05280ffdd0 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f051fe00640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 0x7f0528198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.474+0000 7f0526a00640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 0x7f0528198050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f051800e9c0 tx=0x7f051800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.475+0000 7f051f400640 1 -- 172.21.15.7:0/3150360061 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518009700 con 0x7f05280ffdd0 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.475+0000 7f051f400640 1 -- 172.21.15.7:0/3150360061 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05180044e0 con 0x7f05280ffdd0 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.475+0000 7f051f400640 1 -- 172.21.15.7:0/3150360061 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518010430 con 0x7f05280ffdd0 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.475+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05281a0150 con 0x7f05280ffdd0 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.475+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05281a05e0 con 0x7f05280ffdd0 2024-09-13T18:14:42.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.476+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052810b6c0 con 0x7f05280ffdd0 2024-09-13T18:14:42.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.478+0000 7f051f400640 1 -- 172.21.15.7:0/3150360061 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f0518003f60 con 0x7f05280ffdd0 2024-09-13T18:14:42.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.479+0000 7f051f400640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f050c0a1090 0x7f050c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.479+0000 7f051f400640 1 -- 172.21.15.7:0/3150360061 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0518014070 con 0x7f05280ffdd0 2024-09-13T18:14:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.479+0000 7f051fe00640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f050c0a1090 0x7f050c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:42.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.480+0000 7f051fe00640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f050c0a1090 0x7f050c0a3550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0510005ab0 tx=0x7f0510005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:42.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.483+0000 7f051f400640 1 -- 172.21.15.7:0/3150360061 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0518096560 con 0x7f05280ffdd0 2024-09-13T18:14:42.620 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:42 smithi067 ceph-mon[35103]: Deploying daemon mds.e on smithi067 2024-09-13T18:14:42.621 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:42 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.7:6836/903446377,v1:172.21.15.7:6837/903446377] up:boot 2024-09-13T18:14:42.621 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:42 smithi067 ceph-mon[35103]: fsmap 4 up:standby 2024-09-13T18:14:42.621 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T18:14:42.621 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 podman[64851]: 2024-09-13 18:14:42.491731149 +0000 UTC m=+0.016142743 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:42.621 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 podman[64851]: 2024-09-13 18:14:42.619025468 +0000 UTC m=+0.143437045 container create 722396f69cb4c6fbc2933c24a0cf522b2ad8587ea55ea9f7225b6c23ef725e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T18:14:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.702+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f052810b8f0 con 0x7f05280ffdd0 2024-09-13T18:14:42.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.703+0000 7f051f400640 1 -- 172.21.15.7:0/3150360061 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3516 (secure 0 0 0) 0x7f0518099b80 con 0x7f05280ffdd0 2024-09-13T18:14:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:42.706 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[]} 2024-09-13T18:14:42.706 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.705+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f050c0a1090 msgr2=0x7f050c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.705+0000 7f052d600640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f050c0a1090 0x7f050c0a3550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0510005ab0 tx=0x7f0510005780 comp rx=0 tx=0).stop 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.705+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 msgr2=0x7f0528198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.705+0000 7f052d600640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 0x7f0528198050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f051800e9c0 tx=0x7f051800ee80 comp rx=0 tx=0).stop 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 shutdown_connections 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f050c0a1090 0x7f050c0a3550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528101980 0x7f052819f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0528100fc0 0x7f0528198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 --2- 172.21.15.7:0/3150360061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05280ffdd0 0x7f0528198050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 >> 172.21.15.7:0/3150360061 conn(0x7f05280fb590 msgr2=0x7f0528106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 shutdown_connections 2024-09-13T18:14:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:42.706+0000 7f052d600640 1 -- 172.21.15.7:0/3150360061 wait complete. 2024-09-13T18:14:42.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:42 smithi116 ceph-mon[35109]: Deploying daemon mds.e on smithi067 2024-09-13T18:14:42.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:42 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.7:6836/903446377,v1:172.21.15.7:6837/903446377] up:boot 2024-09-13T18:14:42.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:42 smithi116 ceph-mon[35109]: fsmap 4 up:standby 2024-09-13T18:14:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T18:14:42.722 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:42 smithi007 ceph-mon[30588]: Deploying daemon mds.e on smithi067 2024-09-13T18:14:42.722 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:42 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.7:6836/903446377,v1:172.21.15.7:6837/903446377] up:boot 2024-09-13T18:14:42.722 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:42 smithi007 ceph-mon[30588]: fsmap 4 up:standby 2024-09-13T18:14:42.722 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T18:14:42.872 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 podman[64851]: 2024-09-13 18:14:42.867497179 +0000 UTC m=+0.391908759 container init 722396f69cb4c6fbc2933c24a0cf522b2ad8587ea55ea9f7225b6c23ef725e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:14:43.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 podman[64851]: 2024-09-13 18:14:42.870300092 +0000 UTC m=+0.394711670 container start 722396f69cb4c6fbc2933c24a0cf522b2ad8587ea55ea9f7225b6c23ef725e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:14:43.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 ceph-mds[64871]: -- 172.21.15.67:0/2513436290 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ac247f0d00 con 0x55ac247c4800 2024-09-13T18:14:43.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e[64867]: starting mds.e at 2024-09-13T18:14:43.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 bash[64851]: 722396f69cb4c6fbc2933c24a0cf522b2ad8587ea55ea9f7225b6c23ef725e1c 2024-09-13T18:14:43.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:14:42 smithi067 systemd[1]: Started Ceph mds.e for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:43.601 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:43.602 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3150360061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:43.602 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.602 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.602 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.602 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:43.602 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:43.602 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3150360061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:43.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3150360061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:44.613 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:44 smithi116 ceph-mon[35109]: Deploying daemon mds.f on smithi116 2024-09-13T18:14:44.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:44 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6834/833350667,v1:172.21.15.67:6835/833350667] up:boot 2024-09-13T18:14:44.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:44 smithi116 ceph-mon[35109]: fsmap 5 up:standby 2024-09-13T18:14:44.614 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:44 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:14:44.724 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:44 smithi067 ceph-mon[35103]: Deploying daemon mds.f on smithi116 2024-09-13T18:14:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:44 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6834/833350667,v1:172.21.15.67:6835/833350667] up:boot 2024-09-13T18:14:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:44 smithi067 ceph-mon[35103]: fsmap 5 up:standby 2024-09-13T18:14:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:44 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:14:44.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:44 smithi007 ceph-mon[30588]: Deploying daemon mds.f on smithi116 2024-09-13T18:14:44.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:44 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6834/833350667,v1:172.21.15.67:6835/833350667] up:boot 2024-09-13T18:14:44.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:44 smithi007 ceph-mon[30588]: fsmap 5 up:standby 2024-09-13T18:14:44.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:44 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:14:44.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 -- 172.21.15.7:0/2579139336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5980101fe0 msgr2=0x7f59801023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 --2- 172.21.15.7:0/2579139336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5980101fe0 0x7f59801023e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5970009900 tx=0x7f597002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 -- 172.21.15.7:0/2579139336 shutdown_connections 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 --2- 172.21.15.7:0/2579139336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5980103b90 0x7f598010a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 --2- 172.21.15.7:0/2579139336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59801031d0 0x7f5980103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 --2- 172.21.15.7:0/2579139336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5980101fe0 0x7f59801023e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 -- 172.21.15.7:0/2579139336 >> 172.21.15.7:0/2579139336 conn(0x7f59800fd760 msgr2=0x7f59800ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 -- 172.21.15.7:0/2579139336 shutdown_connections 2024-09-13T18:14:44.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.892+0000 7f5985200640 1 -- 172.21.15.7:0/2579139336 wait complete. 2024-09-13T18:14:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 Processor -- start 2024-09-13T18:14:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 -- start start 2024-09-13T18:14:44.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980101fe0 0x7f5980197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59801031d0 0x7f59801984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5980103b90 0x7f598019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598019faa0 con 0x7f59801031d0 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598019fc10 con 0x7f5980103b90 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.893+0000 7f5985200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598019fdd0 con 0x7f5980101fe0 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980101fe0 0x7f5980197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59801031d0 0x7f59801984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980101fe0 0x7f5980197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:42780/0 (socket says 172.21.15.7:42780) 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597de00640 1 -- 172.21.15.7:0/3596877939 learned_addr learned my addr 172.21.15.7:0/3596877939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597e800640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5980103b90 0x7f598019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597d400640 1 -- 172.21.15.7:0/3596877939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980101fe0 msgr2=0x7f5980197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:44.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597d400640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980101fe0 0x7f5980197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597d400640 1 -- 172.21.15.7:0/3596877939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5980103b90 msgr2=0x7f598019f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597d400640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5980103b90 0x7f598019f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597d400640 1 -- 172.21.15.7:0/3596877939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c009490 con 0x7f59801031d0 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597de00640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980101fe0 0x7f5980197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.894+0000 7f597d400640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59801031d0 0x7f59801984f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f596c00e9f0 tx=0x7f596c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.895+0000 7f5976a00640 1 -- 172.21.15.7:0/3596877939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c00cd80 con 0x7f59801031d0 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.895+0000 7f5976a00640 1 -- 172.21.15.7:0/3596877939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f596c0035f0 con 0x7f59801031d0 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.895+0000 7f5976a00640 1 -- 172.21.15.7:0/3596877939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c0044e0 con 0x7f59801031d0 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.895+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5970009560 con 0x7f59801031d0 2024-09-13T18:14:44.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.895+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59801a0430 con 0x7f59801031d0 2024-09-13T18:14:44.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.896+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5980109510 con 0x7f59801031d0 2024-09-13T18:14:44.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.898+0000 7f5976a00640 1 -- 172.21.15.7:0/3596877939 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f596c003a60 con 0x7f59801031d0 2024-09-13T18:14:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.900+0000 7f5976a00640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f59640a1110 0x7f59640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.900+0000 7f5976a00640 1 -- 172.21.15.7:0/3596877939 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f596c014070 con 0x7f59801031d0 2024-09-13T18:14:44.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.900+0000 7f597de00640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f59640a1110 0x7f59640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:44.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.901+0000 7f597de00640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f59640a1110 0x7f59640a35d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5970004650 tx=0x7f59700314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:44.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:44.904+0000 7f5976a00640 1 -- 172.21.15.7:0/3596877939 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f596c0963c0 con 0x7f59801031d0 2024-09-13T18:14:44.960 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:44 smithi116 systemd[1]: Starting Ceph mds.f for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.120+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5980108f80 con 0x7f59801031d0 2024-09-13T18:14:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.121+0000 7f5976a00640 1 -- 172.21.15.7:0/3596877939 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4270 (secure 0 0 0) 0x7f596c0999e0 con 0x7f59801031d0 2024-09-13T18:14:45.124 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:45.124 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-09-13T18:14:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f59640a1110 msgr2=0x7f59640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f59640a1110 0x7f59640a35d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5970004650 tx=0x7f59700314a0 comp rx=0 tx=0).stop 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59801031d0 msgr2=0x7f59801984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59801031d0 0x7f59801984f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f596c00e9f0 tx=0x7f596c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 shutdown_connections 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f59640a1110 0x7f59640a35d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5980103b90 0x7f598019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f59801031d0 0x7f59801984f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 --2- 172.21.15.7:0/3596877939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5980101fe0 0x7f5980197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.123+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 >> 172.21.15.7:0/3596877939 conn(0x7f59800fd760 msgr2=0x7f59801066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.124+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 shutdown_connections 2024-09-13T18:14:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:45.124+0000 7f5985200640 1 -- 172.21.15.7:0/3596877939 wait complete. 2024-09-13T18:14:45.275 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 podman[65560]: 2024-09-13 18:14:45.012133637 +0000 UTC m=+0.111289847 container create df9b330ee1299fe1a5027ac20c9a5873ee96713dfd7809801e29f20a911ffd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T18:14:45.275 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 podman[65560]: 2024-09-13 18:14:44.916538479 +0000 UTC m=+0.015694644 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:45.275 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 podman[65560]: 2024-09-13 18:14:45.247558528 +0000 UTC m=+0.346714693 container init df9b330ee1299fe1a5027ac20c9a5873ee96713dfd7809801e29f20a911ffd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:14:45.275 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 podman[65560]: 2024-09-13 18:14:45.250493275 +0000 UTC m=+0.349649443 container start df9b330ee1299fe1a5027ac20c9a5873ee96713dfd7809801e29f20a911ffd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2) 2024-09-13T18:14:45.276 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 ceph-mds[65578]: -- 172.21.15.116:0/3609839591 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a1399aad00 con 0x55a13997f000 2024-09-13T18:14:45.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:45 smithi007 ceph-mon[30588]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:45.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:45 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3596877939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:45.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:45 smithi116 ceph-mon[35109]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:45.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:45 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3596877939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:45.711 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f[65574]: starting mds.f at 2024-09-13T18:14:45.711 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 bash[65560]: df9b330ee1299fe1a5027ac20c9a5873ee96713dfd7809801e29f20a911ffd05 2024-09-13T18:14:45.711 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:14:45 smithi116 systemd[1]: Started Ceph mds.f for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:45.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:45 smithi067 ceph-mon[35103]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:45.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:45 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3596877939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:46.658 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] up:boot 2024-09-13T18:14:46.658 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: fsmap 6 up:standby 2024-09-13T18:14:46.658 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:14:46.658 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.659 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.659 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.659 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:46.659 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:46.659 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:46.659 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:46 smithi067 ceph-mon[35103]: Deploying daemon mds.c on smithi116 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] up:boot 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: fsmap 6 up:standby 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:46.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:46 smithi116 ceph-mon[35109]: Deploying daemon mds.c on smithi116 2024-09-13T18:14:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] up:boot 2024-09-13T18:14:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: fsmap 6 up:standby 2024-09-13T18:14:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:14:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:46.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:46.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:46.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:46.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:46 smithi007 ceph-mon[30588]: Deploying daemon mds.c on smithi116 2024-09-13T18:14:47.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:47.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 -- 172.21.15.7:0/2862195251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 msgr2=0x7f02e810a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 --2- 172.21.15.7:0/2862195251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e810a420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009be0 tx=0x7f02e002a6c0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 -- 172.21.15.7:0/2862195251 shutdown_connections 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 --2- 172.21.15.7:0/2862195251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e810a420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 --2- 172.21.15.7:0/2862195251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e81031d0 0x7f02e8103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 --2- 172.21.15.7:0/2862195251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e8101fe0 0x7f02e81023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 -- 172.21.15.7:0/2862195251 >> 172.21.15.7:0/2862195251 conn(0x7f02e80fd760 msgr2=0x7f02e80ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 -- 172.21.15.7:0/2862195251 shutdown_connections 2024-09-13T18:14:47.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.307+0000 7f02ee000640 1 -- 172.21.15.7:0/2862195251 wait complete. 2024-09-13T18:14:47.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 Processor -- start 2024-09-13T18:14:47.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 -- start start 2024-09-13T18:14:47.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e8101fe0 0x7f02e8198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:47.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e81031d0 0x7f02e8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:47.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:47.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e819fb10 con 0x7f02e8101fe0 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e819fc80 con 0x7f02e81031d0 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.308+0000 7f02ee000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e819fe40 con 0x7f02e8103b90 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e8101fe0 0x7f02e8198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e819f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:42796/0 (socket says 172.21.15.7:42796) 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 -- 172.21.15.7:0/1175451749 learned_addr learned my addr 172.21.15.7:0/1175451749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02dfe00640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e81031d0 0x7f02e8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 -- 172.21.15.7:0/1175451749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e81031d0 msgr2=0x7f02e8198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e81031d0 0x7f02e8198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 -- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e8101fe0 msgr2=0x7f02e8198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e8101fe0 0x7f02e8198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 -- 172.21.15.7:0/1175451749 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0009560 con 0x7f02e8103b90 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.309+0000 7f02e7e00640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e819f5d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02e002abe0 tx=0x7f02e0003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:47.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.310+0000 7f02e4c00640 1 -- 172.21.15.7:0/1175451749 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0004040 con 0x7f02e8103b90 2024-09-13T18:14:47.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.310+0000 7f02e4c00640 1 -- 172.21.15.7:0/1175451749 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e0004660 con 0x7f02e8103b90 2024-09-13T18:14:47.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.310+0000 7f02e4c00640 1 -- 172.21.15.7:0/1175451749 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0031bf0 con 0x7f02e8103b90 2024-09-13T18:14:47.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.310+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e0009840 con 0x7f02e8103b90 2024-09-13T18:14:47.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.310+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e81a03e0 con 0x7f02e8103b90 2024-09-13T18:14:47.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.311+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e81094c0 con 0x7f02e8103b90 2024-09-13T18:14:47.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.313+0000 7f02e4c00640 1 -- 172.21.15.7:0/1175451749 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f02e0038070 con 0x7f02e8103b90 2024-09-13T18:14:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.314+0000 7f02e4c00640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02cc0a1110 0x7f02cc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.314+0000 7f02e4c00640 1 -- 172.21.15.7:0/1175451749 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f02e00ec840 con 0x7f02e8103b90 2024-09-13T18:14:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.314+0000 7f02e7400640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02cc0a1110 0x7f02cc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.315+0000 7f02e7400640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02cc0a1110 0x7f02cc0a35d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02e8103030 tx=0x7f02d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.318+0000 7f02e4c00640 1 -- 172.21.15.7:0/1175451749 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f02e00b6480 con 0x7f02e8103b90 2024-09-13T18:14:47.366 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 systemd[1]: Starting Ceph mds.c for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.536+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02e8108f30 con 0x7f02e8103b90 2024-09-13T18:14:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.537+0000 7f02e4c00640 1 -- 172.21.15.7:0/1175451749 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5030 (secure 0 0 0) 0x7f02e00b9aa0 con 0x7f02e8103b90 2024-09-13T18:14:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:47.541 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-09-13T18:14:47.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:47 smithi007 ceph-mon[30588]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:47.541 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02cc0a1110 msgr2=0x7f02cc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02cc0a1110 0x7f02cc0a35d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02e8103030 tx=0x7f02d8005f90 comp rx=0 tx=0).stop 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 msgr2=0x7f02e819f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e819f5d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02e002abe0 tx=0x7f02e0003ba0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 shutdown_connections 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f02cc0a1110 0x7f02cc0a35d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e8103b90 0x7f02e819f5d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02e81031d0 0x7f02e8198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 --2- 172.21.15.7:0/1175451749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02e8101fe0 0x7f02e8198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.539+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 >> 172.21.15.7:0/1175451749 conn(0x7f02e80fd760 msgr2=0x7f02e8106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.540+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 shutdown_connections 2024-09-13T18:14:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:47.540+0000 7f02ee000640 1 -- 172.21.15.7:0/1175451749 wait complete. 2024-09-13T18:14:47.677 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:47 smithi116 ceph-mon[35109]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:47.677 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 podman[65860]: 2024-09-13 18:14:47.341947896 +0000 UTC m=+0.015945690 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:47.677 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 podman[65860]: 2024-09-13 18:14:47.464628848 +0000 UTC m=+0.138626635 container create 42402498b308713b12e3d2105fa3ae9902f92407eb28fccd589eb59a36ba5381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T18:14:47.677 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 podman[65860]: 2024-09-13 18:14:47.675500671 +0000 UTC m=+0.349498456 container init 42402498b308713b12e3d2105fa3ae9902f92407eb28fccd589eb59a36ba5381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:14:47.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:47 smithi067 ceph-mon[35103]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:47.960 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 podman[65860]: 2024-09-13 18:14:47.678238547 +0000 UTC m=+0.352236333 container start 42402498b308713b12e3d2105fa3ae9902f92407eb28fccd589eb59a36ba5381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:14:47.961 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 ceph-mds[65879]: -- 172.21.15.116:0/431558223 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56013f54ed00 con 0x56013f522800 2024-09-13T18:14:47.961 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c[65875]: starting mds.c at 2024-09-13T18:14:47.961 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 bash[65860]: 42402498b308713b12e3d2105fa3ae9902f92407eb28fccd589eb59a36ba5381 2024-09-13T18:14:47.961 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:14:47 smithi116 systemd[1]: Started Ceph mds.c for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:48 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1175451749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:48.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:48.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:48 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:48.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:48 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1175451749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:48.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:48.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:48.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:48 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:48 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1175451749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:48 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:49.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:49.652 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:49 smithi067 ceph-mon[35103]: Deploying daemon mds.h on smithi067 2024-09-13T18:14:49.653 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:49 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] up:boot 2024-09-13T18:14:49.653 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:49 smithi067 ceph-mon[35103]: fsmap 7 up:standby 2024-09-13T18:14:49.653 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:49 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:14:49.653 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:49 smithi067 ceph-mon[35103]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:49.653 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:49 smithi067 systemd[1]: Starting Ceph mds.h for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:49.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:49 smithi116 ceph-mon[35109]: Deploying daemon mds.h on smithi067 2024-09-13T18:14:49.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:49 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] up:boot 2024-09-13T18:14:49.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:49 smithi116 ceph-mon[35109]: fsmap 7 up:standby 2024-09-13T18:14:49.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:49 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:14:49.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:49 smithi116 ceph-mon[35109]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:49.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 -- 172.21.15.7:0/1259599714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35641031d0 msgr2=0x7f3564103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 --2- 172.21.15.7:0/1259599714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35641031d0 0x7f3564103650 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3550009900 tx=0x7f355002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 -- 172.21.15.7:0/1259599714 shutdown_connections 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 --2- 172.21.15.7:0/1259599714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3564103b90 0x7f356410a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 --2- 172.21.15.7:0/1259599714 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35641031d0 0x7f3564103650 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 --2- 172.21.15.7:0/1259599714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3564101fe0 0x7f35641023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 -- 172.21.15.7:0/1259599714 >> 172.21.15.7:0/1259599714 conn(0x7f35640fd760 msgr2=0x7f35640ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 -- 172.21.15.7:0/1259599714 shutdown_connections 2024-09-13T18:14:49.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.726+0000 7f356a600640 1 -- 172.21.15.7:0/1259599714 wait complete. 2024-09-13T18:14:49.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.727+0000 7f356a600640 1 Processor -- start 2024-09-13T18:14:49.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.727+0000 7f356a600640 1 -- start start 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.727+0000 7f356a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564101fe0 0x7f3564198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.727+0000 7f356a600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35641031d0 0x7f3564198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f356a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3564103b90 0x7f356419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f356a600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356419fb40 con 0x7f3564103b90 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f356a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356419fcb0 con 0x7f3564101fe0 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f356a600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356419fe70 con 0x7f35641031d0 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564101fe0 0x7f3564198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564101fe0 0x7f3564198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:56082/0 (socket says 172.21.15.7:56082) 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 -- 172.21.15.7:0/1464951825 learned_addr learned my addr 172.21.15.7:0/1464951825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563e00640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3564103b90 0x7f356419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:49.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3562a00640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35641031d0 0x7f3564198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 -- 172.21.15.7:0/1464951825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35641031d0 msgr2=0x7f3564198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35641031d0 0x7f3564198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 -- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3564103b90 msgr2=0x7f356419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3564103b90 0x7f356419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.728+0000 7f3563400640 1 -- 172.21.15.7:0/1464951825 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009840 con 0x7f3564101fe0 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.729+0000 7f3563400640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564101fe0 0x7f3564198050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f355400e9c0 tx=0x7f355400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.729+0000 7f355be00640 1 -- 172.21.15.7:0/1464951825 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540096e0 con 0x7f3564101fe0 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.729+0000 7f355be00640 1 -- 172.21.15.7:0/1464951825 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35540044f0 con 0x7f3564101fe0 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.729+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3550009560 con 0x7f3564101fe0 2024-09-13T18:14:49.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.729+0000 7f355be00640 1 -- 172.21.15.7:0/1464951825 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554003e50 con 0x7f3564101fe0 2024-09-13T18:14:49.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.729+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35641a0450 con 0x7f3564101fe0 2024-09-13T18:14:49.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.730+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3564109490 con 0x7f3564101fe0 2024-09-13T18:14:49.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.732+0000 7f355be00640 1 -- 172.21.15.7:0/1464951825 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f3554004000 con 0x7f3564101fe0 2024-09-13T18:14:49.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.733+0000 7f355be00640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f35480a1090 0x7f35480a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.733+0000 7f355be00640 1 -- 172.21.15.7:0/1464951825 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3554014070 con 0x7f3564101fe0 2024-09-13T18:14:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.734+0000 7f3562a00640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f35480a1090 0x7f35480a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:49.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.734+0000 7f3562a00640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f35480a1090 0x7f35480a3550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3550005ab0 tx=0x7f3550005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:49.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.736+0000 7f355be00640 1 -- 172.21.15.7:0/1464951825 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3554096510 con 0x7f3564101fe0 2024-09-13T18:14:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:49 smithi007 ceph-mon[30588]: Deploying daemon mds.h on smithi067 2024-09-13T18:14:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:49 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] up:boot 2024-09-13T18:14:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:49 smithi007 ceph-mon[30588]: fsmap 7 up:standby 2024-09-13T18:14:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:49 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:14:49.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:49 smithi007 ceph-mon[30588]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.952+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f356410d8f0 con 0x7f3564101fe0 2024-09-13T18:14:49.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.953+0000 7f355be00640 1 -- 172.21.15.7:0/1464951825 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5790 (secure 0 0 0) 0x7f3554099b30 con 0x7f3564101fe0 2024-09-13T18:14:49.959 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:49.959 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T18:14:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-09-13T18:14:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.955+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f35480a1090 msgr2=0x7f35480a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.955+0000 7f356a600640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f35480a1090 0x7f35480a3550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3550005ab0 tx=0x7f3550005780 comp rx=0 tx=0).stop 2024-09-13T18:14:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.955+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564101fe0 msgr2=0x7f3564198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.955+0000 7f356a600640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564101fe0 0x7f3564198050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f355400e9c0 tx=0x7f355400edc0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 shutdown_connections 2024-09-13T18:14:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f35480a1090 0x7f35480a3550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3564103b90 0x7f356419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35641031d0 0x7f3564198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 --2- 172.21.15.7:0/1464951825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564101fe0 0x7f3564198050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 >> 172.21.15.7:0/1464951825 conn(0x7f35640fd760 msgr2=0x7f3564106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 shutdown_connections 2024-09-13T18:14:49.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:49.956+0000 7f356a600640 1 -- 172.21.15.7:0/1464951825 wait complete. 2024-09-13T18:14:49.995 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:49 smithi067 podman[65152]: 2024-09-13 18:14:49.767335427 +0000 UTC m=+0.016314623 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:49.995 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:49 smithi067 podman[65152]: 2024-09-13 18:14:49.892704213 +0000 UTC m=+0.141683399 container create 418d363034d35bd21f5141f898d8f9d6a6429f205d6649b1f4c734f57b407083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:14:50.386 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:50 smithi067 podman[65152]: 2024-09-13 18:14:50.111670765 +0000 UTC m=+0.360649961 container init 418d363034d35bd21f5141f898d8f9d6a6429f205d6649b1f4c734f57b407083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T18:14:50.386 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:50 smithi067 podman[65152]: 2024-09-13 18:14:50.114339841 +0000 UTC m=+0.363319034 container start 418d363034d35bd21f5141f898d8f9d6a6429f205d6649b1f4c734f57b407083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T18:14:50.386 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mds[65171]: -- 172.21.15.67:0/1700401609 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556b14f1ed00 con 0x556b14ef3000 2024-09-13T18:14:50.386 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h[65167]: starting mds.h at 2024-09-13T18:14:50.387 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:50 smithi067 bash[65152]: 418d363034d35bd21f5141f898d8f9d6a6429f205d6649b1f4c734f57b407083 2024-09-13T18:14:50.387 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:14:50 smithi067 systemd[1]: Started Ceph mds.h for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:50.637 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:50 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1464951825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:50.637 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.637 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.637 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.637 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:50.637 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:50.637 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:50 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1464951825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:50 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:50 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1464951825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:50 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:51.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:51 smithi116 ceph-mon[35109]: Deploying daemon mds.i on smithi116 2024-09-13T18:14:51.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:51 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] up:boot 2024-09-13T18:14:51.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:51 smithi116 ceph-mon[35109]: fsmap 8 up:standby 2024-09-13T18:14:51.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:51 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:14:51.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:51 smithi116 ceph-mon[35109]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:51.647 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:51 smithi067 ceph-mon[35103]: Deploying daemon mds.i on smithi116 2024-09-13T18:14:51.648 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:51 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] up:boot 2024-09-13T18:14:51.648 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:51 smithi067 ceph-mon[35103]: fsmap 8 up:standby 2024-09-13T18:14:51.648 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:51 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:14:51.648 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:51 smithi067 ceph-mon[35103]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:51 smithi007 ceph-mon[30588]: Deploying daemon mds.i on smithi116 2024-09-13T18:14:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:51 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] up:boot 2024-09-13T18:14:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:51 smithi007 ceph-mon[30588]: fsmap 8 up:standby 2024-09-13T18:14:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:51 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:14:51.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:51 smithi007 ceph-mon[30588]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:51.976 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:52.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 -- 172.21.15.7:0/2491895363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c102000 msgr2=0x7f755c102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 --2- 172.21.15.7:0/2491895363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c102000 0x7f755c102400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f754c009900 tx=0x7f754c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 -- 172.21.15.7:0/2491895363 shutdown_connections 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 --2- 172.21.15.7:0/2491895363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c103bb0 0x7f755c10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 --2- 172.21.15.7:0/2491895363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 0x7f755c103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 --2- 172.21.15.7:0/2491895363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c102000 0x7f755c102400 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 -- 172.21.15.7:0/2491895363 >> 172.21.15.7:0/2491895363 conn(0x7f755c0fd760 msgr2=0x7f755c0ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 -- 172.21.15.7:0/2491895363 shutdown_connections 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.141+0000 7f7561600640 1 -- 172.21.15.7:0/2491895363 wait complete. 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 Processor -- start 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 -- start start 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c102000 0x7f755c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:52.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 0x7f755c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c103bb0 0x7f755c19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c19fb10 con 0x7f755c1031f0 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c19fc80 con 0x7f755c102000 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.142+0000 7f7561600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c19fe40 con 0x7f755c103bb0 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f7552000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 0x7f755c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c102000 0x7f755c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c102000 0x7f755c198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:56098/0 (socket says 172.21.15.7:56098) 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755aa00640 1 -- 172.21.15.7:0/3728748754 learned_addr learned my addr 172.21.15.7:0/3728748754 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f7552000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 0x7f755c198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44220/0 (socket says 172.21.15.7:44220) 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755b400640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c103bb0 0x7f755c19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755b400640 1 -- 172.21.15.7:0/3728748754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c102000 msgr2=0x7f755c198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:52.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755b400640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c102000 0x7f755c198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755b400640 1 -- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 msgr2=0x7f755c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755b400640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 0x7f755c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755b400640 1 -- 172.21.15.7:0/3728748754 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009560 con 0x7f755c103bb0 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f7552000640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 0x7f755c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.143+0000 7f755b400640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c103bb0 0x7f755c19f5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7554009fd0 tx=0x7f755400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.144+0000 7f7553e00640 1 -- 172.21.15.7:0/3728748754 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400ce20 con 0x7f755c103bb0 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.144+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c1a0120 con 0x7f755c103bb0 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.144+0000 7f7553e00640 1 -- 172.21.15.7:0/3728748754 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7554005020 con 0x7f755c103bb0 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.144+0000 7f7553e00640 1 -- 172.21.15.7:0/3728748754 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554010670 con 0x7f755c103bb0 2024-09-13T18:14:52.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.144+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c1a0680 con 0x7f755c103bb0 2024-09-13T18:14:52.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.145+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c1094d0 con 0x7f755c103bb0 2024-09-13T18:14:52.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.147+0000 7f7553e00640 1 -- 172.21.15.7:0/3728748754 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f7554005450 con 0x7f755c103bb0 2024-09-13T18:14:52.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.148+0000 7f7553e00640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f75400a1110 0x7f75400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:52.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.148+0000 7f7553e00640 1 -- 172.21.15.7:0/3728748754 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7554014070 con 0x7f755c103bb0 2024-09-13T18:14:52.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.148+0000 7f755aa00640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f75400a1110 0x7f75400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:52.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.149+0000 7f755aa00640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f75400a1110 0x7f75400a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f754c000c00 tx=0x7f754c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:52.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.150+0000 7f7553e00640 1 -- 172.21.15.7:0/3728748754 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7554096640 con 0x7f755c103bb0 2024-09-13T18:14:52.211 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 systemd[1]: Starting Ceph mds.i for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:52.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.369+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f755c10d920 con 0x7f755c103bb0 2024-09-13T18:14:52.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.370+0000 7f7553e00640 1 -- 172.21.15.7:0/3728748754 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6547 (secure 0 0 0) 0x7f7554099c60 con 0x7f755c103bb0 2024-09-13T18:14:52.374 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:52.374 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T18:14:52.374 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2024-09-13T18:14:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.372+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f75400a1110 msgr2=0x7f75400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.372+0000 7f7561600640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f75400a1110 0x7f75400a35d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f754c000c00 tx=0x7f754c005780 comp rx=0 tx=0).stop 2024-09-13T18:14:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.372+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c103bb0 msgr2=0x7f755c19f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:52.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.372+0000 7f7561600640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c103bb0 0x7f755c19f5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7554009fd0 tx=0x7f755400ef10 comp rx=0 tx=0).stop 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 shutdown_connections 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f75400a1110 0x7f75400a35d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f755c103bb0 0x7f755c19f5d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f755c1031f0 0x7f755c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 --2- 172.21.15.7:0/3728748754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f755c102000 0x7f755c198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 >> 172.21.15.7:0/3728748754 conn(0x7f755c0fd760 msgr2=0x7f755c1066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 shutdown_connections 2024-09-13T18:14:52.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:52.373+0000 7f7561600640 1 -- 172.21.15.7:0/3728748754 wait complete. 2024-09-13T18:14:52.567 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:52 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3728748754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:52.567 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 podman[66168]: 2024-09-13 18:14:52.21241696 +0000 UTC m=+0.016366163 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:52.567 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 podman[66168]: 2024-09-13 18:14:52.31095199 +0000 UTC m=+0.114901186 container create 1328e0a290ed4c199f77b5889c5f1f903a82d25ee27ec4d49d3a3e84d34c3e3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:14:52.567 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 podman[66168]: 2024-09-13 18:14:52.53837955 +0000 UTC m=+0.342328749 container init 1328e0a290ed4c199f77b5889c5f1f903a82d25ee27ec4d49d3a3e84d34c3e3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T18:14:52.567 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 podman[66168]: 2024-09-13 18:14:52.541967626 +0000 UTC m=+0.345916822 container start 1328e0a290ed4c199f77b5889c5f1f903a82d25ee27ec4d49d3a3e84d34c3e3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T18:14:52.567 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 ceph-mds[66193]: -- 172.21.15.116:0/1657193136 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ce33f90d00 con 0x55ce33f64800 2024-09-13T18:14:52.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:52 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3728748754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:52 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3728748754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:52.960 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i[66183]: starting mds.i at 2024-09-13T18:14:52.961 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 bash[66168]: 1328e0a290ed4c199f77b5889c5f1f903a82d25ee27ec4d49d3a3e84d34c3e3f 2024-09-13T18:14:52.961 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:14:52 smithi116 systemd[1]: Started Ceph mds.i for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:53.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:53 smithi007 ceph-mon[30588]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:53.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:53.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:53.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:53 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:53.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:53 smithi116 ceph-mon[35109]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:53.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:53.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:53.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:53 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:53 smithi067 ceph-mon[35103]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:53.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:53.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:53 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:54.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:54.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 -- 172.21.15.7:0/818628509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0103180 msgr2=0x7ffba0105570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 --2- 172.21.15.7:0/818628509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0103180 0x7ffba0105570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009900 tx=0x7ffb8c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 -- 172.21.15.7:0/818628509 shutdown_connections 2024-09-13T18:14:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 --2- 172.21.15.7:0/818628509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba0105ab0 0x7ffba0107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 --2- 172.21.15.7:0/818628509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0103180 0x7ffba0105570 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 --2- 172.21.15.7:0/818628509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffba0100850 0x7ffba0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 -- 172.21.15.7:0/818628509 >> 172.21.15.7:0/818628509 conn(0x7ffba00fa430 msgr2=0x7ffba00fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:54.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 -- 172.21.15.7:0/818628509 shutdown_connections 2024-09-13T18:14:54.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.570+0000 7ffba8000640 1 -- 172.21.15.7:0/818628509 wait complete. 2024-09-13T18:14:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.571+0000 7ffba8000640 1 Processor -- start 2024-09-13T18:14:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.571+0000 7ffba8000640 1 -- start start 2024-09-13T18:14:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba8000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0100850 0x7ffba0198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba8000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffba0103180 0x7ffba01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba8000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba0105ab0 0x7ffba019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:54.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba8000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba019fb70 con 0x7ffba0100850 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba8000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba019fce0 con 0x7ffba0105ab0 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba8000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba019fea0 con 0x7ffba0103180 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0100850 0x7ffba0198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0100850 0x7ffba0198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48482/0 (socket says 172.21.15.7:48482) 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 -- 172.21.15.7:0/1123043859 learned_addr learned my addr 172.21.15.7:0/1123043859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba4c00640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffba0103180 0x7ffba01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba6000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba0105ab0 0x7ffba019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 -- 172.21.15.7:0/1123043859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffba0103180 msgr2=0x7ffba01985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffba0103180 0x7ffba01985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 -- 172.21.15.7:0/1123043859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba0105ab0 msgr2=0x7ffba019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba0105ab0 0x7ffba019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.572+0000 7ffba5600640 1 -- 172.21.15.7:0/1123043859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c009560 con 0x7ffba0100850 2024-09-13T18:14:54.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.573+0000 7ffba5600640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0100850 0x7ffba0198080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400e9f0 tx=0x7ffb9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:54.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.573+0000 7ffb9e000640 1 -- 172.21.15.7:0/1123043859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94009720 con 0x7ffba0100850 2024-09-13T18:14:54.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.573+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba01a0180 con 0x7ffba0100850 2024-09-13T18:14:54.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.573+0000 7ffb9e000640 1 -- 172.21.15.7:0/1123043859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb9400cd80 con 0x7ffba0100850 2024-09-13T18:14:54.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.573+0000 7ffb9e000640 1 -- 172.21.15.7:0/1123043859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94010430 con 0x7ffba0100850 2024-09-13T18:14:54.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.573+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba01a0610 con 0x7ffba0100850 2024-09-13T18:14:54.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.574+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba01075f0 con 0x7ffba0100850 2024-09-13T18:14:54.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.576+0000 7ffb9e000640 1 -- 172.21.15.7:0/1123043859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7ffb94005020 con 0x7ffba0100850 2024-09-13T18:14:54.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.578+0000 7ffb9e000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb880a1090 0x7ffb880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.579+0000 7ffb9e000640 1 -- 172.21.15.7:0/1123043859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffb94014070 con 0x7ffba0100850 2024-09-13T18:14:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.579+0000 7ffba4c00640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb880a1090 0x7ffb880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:54.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.580+0000 7ffba4c00640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb880a1090 0x7ffb880a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c031500 tx=0x7ffb8c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:54.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.583+0000 7ffb9e000640 1 -- 172.21.15.7:0/1123043859 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb940963a0 con 0x7ffba0100850 2024-09-13T18:14:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:54 smithi116 ceph-mon[35109]: Deploying daemon mds.g on smithi007 2024-09-13T18:14:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:54 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] up:boot 2024-09-13T18:14:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:54 smithi116 ceph-mon[35109]: fsmap 9 up:standby 2024-09-13T18:14:54.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:54 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:14:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:54 smithi067 ceph-mon[35103]: Deploying daemon mds.g on smithi007 2024-09-13T18:14:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:54 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] up:boot 2024-09-13T18:14:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:54 smithi067 ceph-mon[35103]: fsmap 9 up:standby 2024-09-13T18:14:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:54 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:14:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:54 smithi007 ceph-mon[30588]: Deploying daemon mds.g on smithi007 2024-09-13T18:14:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:54 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] up:boot 2024-09-13T18:14:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:54 smithi007 ceph-mon[30588]: fsmap 9 up:standby 2024-09-13T18:14:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:54 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:14:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.818+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffba010b710 con 0x7ffba0100850 2024-09-13T18:14:54.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.818+0000 7ffb9e000640 1 -- 172.21.15.7:0/1123043859 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7306 (secure 0 0 0) 0x7ffba010b710 con 0x7ffba0100850 2024-09-13T18:14:54.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:54.822 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T18:14:54.822 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 10 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.820+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb880a1090 msgr2=0x7ffb880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.820+0000 7ffba8000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb880a1090 0x7ffb880a3550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c031500 tx=0x7ffb8c005780 comp rx=0 tx=0).stop 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.820+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0100850 msgr2=0x7ffba0198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.820+0000 7ffba8000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0100850 0x7ffba0198080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400e9f0 tx=0x7ffb9400edf0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 shutdown_connections 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ffb880a1090 0x7ffb880a3550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba0105ab0 0x7ffba019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffba0103180 0x7ffba01985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 --2- 172.21.15.7:0/1123043859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba0100850 0x7ffba0198080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 >> 172.21.15.7:0/1123043859 conn(0x7ffba00fa430 msgr2=0x7ffba00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 shutdown_connections 2024-09-13T18:14:54.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:54.821+0000 7ffba8000640 1 -- 172.21.15.7:0/1123043859 wait complete. 2024-09-13T18:14:55.404 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 systemd[1]: Starting Ceph mds.g for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:55.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:55 smithi116 ceph-mon[35109]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:55.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:55 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1123043859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:55.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:55 smithi067 ceph-mon[35103]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:55.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:55 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1123043859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:55.764 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:55 smithi007 ceph-mon[30588]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:55.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:55 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1123043859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:55.765 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 podman[71152]: 2024-09-13 18:14:55.3511424 +0000 UTC m=+0.028554009 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:55.765 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 podman[71152]: 2024-09-13 18:14:55.497788774 +0000 UTC m=+0.175200373 container create cf13c7c6ff91fe39cc7e354215b92b9bc77661f7d40109e9b1fa178d277225f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-13T18:14:56.041 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 podman[71152]: 2024-09-13 18:14:55.769917286 +0000 UTC m=+0.447328916 container init cf13c7c6ff91fe39cc7e354215b92b9bc77661f7d40109e9b1fa178d277225f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T18:14:56.041 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 podman[71152]: 2024-09-13 18:14:55.776472538 +0000 UTC m=+0.453884138 container start cf13c7c6ff91fe39cc7e354215b92b9bc77661f7d40109e9b1fa178d277225f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T18:14:56.041 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 ceph-mds[71179]: -- 172.21.15.7:0/1718013437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5585c720ad00 con 0x5585c71df400 2024-09-13T18:14:56.041 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g[71170]: starting mds.g at 2024-09-13T18:14:56.041 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 bash[71152]: cf13c7c6ff91fe39cc7e354215b92b9bc77661f7d40109e9b1fa178d277225f3 2024-09-13T18:14:56.041 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:14:55 smithi007 systemd[1]: Started Ceph mds.g for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:56.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:57.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.008+0000 7f9d2f000640 1 -- 172.21.15.7:0/3006209163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280744f0 msgr2=0x7f9d28072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:57.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.008+0000 7f9d2f000640 1 --2- 172.21.15.7:0/3006209163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280744f0 0x7f9d28072940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009900 tx=0x7f9d1802a410 comp rx=0 tx=0).stop 2024-09-13T18:14:57.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.008+0000 7f9d2f000640 1 -- 172.21.15.7:0/3006209163 shutdown_connections 2024-09-13T18:14:57.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.008+0000 7f9d2f000640 1 --2- 172.21.15.7:0/3006209163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d28107c40 0x7f9d2810a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.008+0000 7f9d2f000640 1 --2- 172.21.15.7:0/3006209163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28072f10 0x7f9d28073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.008+0000 7f9d2f000640 1 --2- 172.21.15.7:0/3006209163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d280744f0 0x7f9d28072940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.009+0000 7f9d2f000640 1 -- 172.21.15.7:0/3006209163 >> 172.21.15.7:0/3006209163 conn(0x7f9d280fb590 msgr2=0x7f9d280fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.009+0000 7f9d2f000640 1 -- 172.21.15.7:0/3006209163 shutdown_connections 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.009+0000 7f9d2f000640 1 -- 172.21.15.7:0/3006209163 wait complete. 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.009+0000 7f9d2f000640 1 Processor -- start 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2f000640 1 -- start start 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28072f10 0x7f9d28198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d280744f0 0x7f9d28198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2f000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28107c40 0x7f9d2819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:57.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2819fae0 con 0x7f9d28072f10 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2819fc50 con 0x7f9d280744f0 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2f000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2819fe10 con 0x7f9d28107c40 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2d000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28107c40 0x7f9d2819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2d000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28107c40 0x7f9d2819f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:35870/0 (socket says 172.21.15.7:35870) 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d2d000640 1 -- 172.21.15.7:0/1991705603 learned_addr learned my addr 172.21.15.7:0/1991705603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d27e00640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28072f10 0x7f9d28198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.010+0000 7f9d1f400640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d280744f0 0x7f9d28198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2d000640 1 -- 172.21.15.7:0/1991705603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d280744f0 msgr2=0x7f9d28198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2d000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d280744f0 0x7f9d28198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2d000640 1 -- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28072f10 msgr2=0x7f9d28198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2d000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28072f10 0x7f9d28198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2d000640 1 -- 172.21.15.7:0/1991705603 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009560 con 0x7f9d28107c40 2024-09-13T18:14:57.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2d000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28107c40 0x7f9d2819f5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009fd0 tx=0x7f9d2000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:57.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d25600640 1 -- 172.21.15.7:0/1991705603 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000bea0 con 0x7f9d28107c40 2024-09-13T18:14:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d25600640 1 -- 172.21.15.7:0/1991705603 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d20009940 con 0x7f9d28107c40 2024-09-13T18:14:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d281a00f0 con 0x7f9d28107c40 2024-09-13T18:14:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d25600640 1 -- 172.21.15.7:0/1991705603 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200106c0 con 0x7f9d28107c40 2024-09-13T18:14:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.011+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d281a0600 con 0x7f9d28107c40 2024-09-13T18:14:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.012+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d281069c0 con 0x7f9d28107c40 2024-09-13T18:14:57.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.014+0000 7f9d25600640 1 -- 172.21.15.7:0/1991705603 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f9d200041b0 con 0x7f9d28107c40 2024-09-13T18:14:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.015+0000 7f9d25600640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9d0c0a1110 0x7f9d0c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.016+0000 7f9d25600640 1 -- 172.21.15.7:0/1991705603 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9d200cc090 con 0x7f9d28107c40 2024-09-13T18:14:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.016+0000 7f9d27e00640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9d0c0a1110 0x7f9d0c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:57.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.016+0000 7f9d27e00640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9d0c0a1110 0x7f9d0c0a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9d18005ab0 tx=0x7f9d18005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:57.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.019+0000 7f9d25600640 1 -- 172.21.15.7:0/1991705603 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9d20095cd0 con 0x7f9d28107c40 2024-09-13T18:14:57.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.242+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d28106430 con 0x7f9d28107c40 2024-09-13T18:14:57.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.243+0000 7f9d25600640 1 -- 172.21.15.7:0/1991705603 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8061 (secure 0 0 0) 0x7f9d200992f0 con 0x7f9d28107c40 2024-09-13T18:14:57.246 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:57.246 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T18:14:57.247 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 11 2024-09-13T18:14:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: Deploying daemon mds.a on smithi007 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.7:6838/3960338026,v1:172.21.15.7:6839/3960338026] up:boot 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: fsmap 10 up:standby 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:14:57.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:56 smithi067 ceph-mon[35103]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:57.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9d0c0a1110 msgr2=0x7f9d0c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:57.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9d0c0a1110 0x7f9d0c0a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9d18005ab0 tx=0x7f9d18005780 comp rx=0 tx=0).stop 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28107c40 msgr2=0x7f9d2819f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28107c40 0x7f9d2819f5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009fd0 tx=0x7f9d2000b260 comp rx=0 tx=0).stop 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 shutdown_connections 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9d0c0a1110 0x7f9d0c0a35d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d28107c40 0x7f9d2819f5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d280744f0 0x7f9d28198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 --2- 172.21.15.7:0/1991705603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d28072f10 0x7f9d28198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 >> 172.21.15.7:0/1991705603 conn(0x7f9d280fb590 msgr2=0x7f9d28103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.245+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 shutdown_connections 2024-09-13T18:14:57.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:57.246+0000 7f9d2f000640 1 -- 172.21.15.7:0/1991705603 wait complete. 2024-09-13T18:14:57.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:57.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:57.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:57.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: Deploying daemon mds.a on smithi007 2024-09-13T18:14:57.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.7:6838/3960338026,v1:172.21.15.7:6839/3960338026] up:boot 2024-09-13T18:14:57.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: fsmap 10 up:standby 2024-09-13T18:14:57.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:14:57.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:56 smithi007 ceph-mon[30588]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: Deploying daemon mds.a on smithi007 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.7:6838/3960338026,v1:172.21.15.7:6839/3960338026] up:boot 2024-09-13T18:14:57.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: fsmap 10 up:standby 2024-09-13T18:14:57.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:14:57.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:56 smithi116 ceph-mon[35109]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:58.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:57 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1991705603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:58.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:57 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1991705603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:58.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:57 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1991705603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:14:58.622 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 systemd[1]: Starting Ceph mds.a for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:14:58.900 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 podman[71504]: 2024-09-13 18:14:58.524777245 +0000 UTC m=+0.028047826 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:14:58.900 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 podman[71504]: 2024-09-13 18:14:58.650075802 +0000 UTC m=+0.153346369 container create 7d42e4c1aeb6ccda321e2e50fd3a77d15e6556d726b9d7f3acb2243db6d3ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T18:14:58.901 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 podman[71504]: 2024-09-13 18:14:58.855393383 +0000 UTC m=+0.358663977 container init 7d42e4c1aeb6ccda321e2e50fd3a77d15e6556d726b9d7f3acb2243db6d3ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:14:58.901 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 podman[71504]: 2024-09-13 18:14:58.861476196 +0000 UTC m=+0.364746764 container start 7d42e4c1aeb6ccda321e2e50fd3a77d15e6556d726b9d7f3acb2243db6d3ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:14:59.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:58 smithi067 ceph-mon[35103]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:59.269 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:14:59.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:58 smithi007 ceph-mon[30588]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:59.291 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 ceph-mds[71523]: -- 172.21.15.7:0/1880694031 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558f94e62d00 con 0x558f94e36800 2024-09-13T18:14:59.291 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a[71519]: starting mds.a at 2024-09-13T18:14:59.291 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 bash[71504]: 7d42e4c1aeb6ccda321e2e50fd3a77d15e6556d726b9d7f3acb2243db6d3ddda 2024-09-13T18:14:59.291 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:14:58 smithi007 systemd[1]: Started Ceph mds.a for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:14:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.427+0000 7f5d6ce00640 1 -- 172.21.15.7:0/3930758565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d680ffdd0 msgr2=0x7f5d681001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.427+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/3930758565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d680ffdd0 0x7f5d681001d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d58009860 tx=0x7f5d5802a340 comp rx=0 tx=0).stop 2024-09-13T18:14:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.428+0000 7f5d6ce00640 1 -- 172.21.15.7:0/3930758565 shutdown_connections 2024-09-13T18:14:59.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.428+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/3930758565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d68101980 0x7f5d68108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.428+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/3930758565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d68100fc0 0x7f5d68101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.428+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/3930758565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d680ffdd0 0x7f5d681001d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.428+0000 7f5d6ce00640 1 -- 172.21.15.7:0/3930758565 >> 172.21.15.7:0/3930758565 conn(0x7f5d680fb590 msgr2=0x7f5d680fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.428+0000 7f5d6ce00640 1 -- 172.21.15.7:0/3930758565 shutdown_connections 2024-09-13T18:14:59.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.428+0000 7f5d6ce00640 1 -- 172.21.15.7:0/3930758565 wait complete. 2024-09-13T18:14:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 Processor -- start 2024-09-13T18:14:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 -- start start 2024-09-13T18:14:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d680ffdd0 0x7f5d68195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:59.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d68100fc0 0x7f5d68196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d68101980 0x7f5d6819d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6819d8d0 con 0x7f5d680ffdd0 2024-09-13T18:14:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6819da40 con 0x7f5d68101980 2024-09-13T18:14:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d6ce00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6819dc00 con 0x7f5d68100fc0 2024-09-13T18:14:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d680ffdd0 0x7f5d68195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:59.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d65e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d680ffdd0 0x7f5d68195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48564/0 (socket says 172.21.15.7:48564) 2024-09-13T18:14:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d66800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d68101980 0x7f5d6819d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d65e00640 1 -- 172.21.15.7:0/1526636454 learned_addr learned my addr 172.21.15.7:0/1526636454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:14:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.429+0000 7f5d5fe00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d68100fc0 0x7f5d68196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d65e00640 1 -- 172.21.15.7:0/1526636454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d68100fc0 msgr2=0x7f5d68196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:59.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d65e00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d68100fc0 0x7f5d68196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d65e00640 1 -- 172.21.15.7:0/1526636454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d68101980 msgr2=0x7f5d6819d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d65e00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d68101980 0x7f5d6819d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d65e00640 1 -- 172.21.15.7:0/1526636454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d50009560 con 0x7f5d680ffdd0 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d66800640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d68101980 0x7f5d6819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d65e00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d680ffdd0 0x7f5d68195de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d580304b0 tx=0x7f5d58032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d5ea00640 1 -- 172.21.15.7:0/1526636454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58004050 con 0x7f5d680ffdd0 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d5ea00640 1 -- 172.21.15.7:0/1526636454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d58005070 con 0x7f5d680ffdd0 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d58009490 con 0x7f5d680ffdd0 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d5ea00640 1 -- 172.21.15.7:0/1526636454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580049b0 con 0x7f5d680ffdd0 2024-09-13T18:14:59.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.430+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6819e1a0 con 0x7f5d680ffdd0 2024-09-13T18:14:59.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.431+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d68107300 con 0x7f5d680ffdd0 2024-09-13T18:14:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.433+0000 7f5d5ea00640 1 -- 172.21.15.7:0/1526636454 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f5d580041b0 con 0x7f5d680ffdd0 2024-09-13T18:14:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.434+0000 7f5d5ea00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d4c0a1090 0x7f5d4c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:14:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.435+0000 7f5d5ea00640 1 -- 172.21.15.7:0/1526636454 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5d580ecfe0 con 0x7f5d680ffdd0 2024-09-13T18:14:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.435+0000 7f5d5fe00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d4c0a1090 0x7f5d4c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:14:59.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.435+0000 7f5d5fe00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d4c0a1090 0x7f5d4c0a3550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d681972f0 tx=0x7f5d50009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:14:59.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.437+0000 7f5d5ea00640 1 -- 172.21.15.7:0/1526636454 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d580b6bb0 con 0x7f5d680ffdd0 2024-09-13T18:14:59.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:58 smithi116 ceph-mon[35109]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:14:59.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.651+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d6810b670 con 0x7f5d680ffdd0 2024-09-13T18:14:59.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.652+0000 7f5d5ea00640 1 -- 172.21.15.7:0/1526636454 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8816 (secure 0 0 0) 0x7f5d580d8e60 con 0x7f5d680ffdd0 2024-09-13T18:14:59.655 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:14:59.656 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-09-13T18:14:59.656 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 12 2024-09-13T18:14:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d4c0a1090 msgr2=0x7f5d4c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d4c0a1090 0x7f5d4c0a3550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5d681972f0 tx=0x7f5d50009260 comp rx=0 tx=0).stop 2024-09-13T18:14:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d680ffdd0 msgr2=0x7f5d68195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:14:59.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d680ffdd0 0x7f5d68195de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d580304b0 tx=0x7f5d58032d20 comp rx=0 tx=0).stop 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 shutdown_connections 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d4c0a1090 0x7f5d4c0a3550 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d68101980 0x7f5d6819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d68100fc0 0x7f5d68196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 --2- 172.21.15.7:0/1526636454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d680ffdd0 0x7f5d68195de0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 >> 172.21.15.7:0/1526636454 conn(0x7f5d680fb590 msgr2=0x7f5d681044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 shutdown_connections 2024-09-13T18:14:59.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:14:59.654+0000 7f5d6ce00640 1 -- 172.21.15.7:0/1526636454 wait complete. 2024-09-13T18:15:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.7:6840/4101588502,v1:172.21.15.7:6841/4101588502] up:boot 2024-09-13T18:15:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: fsmap 11 up:standby 2024-09-13T18:15:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:15:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:15:00.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:15:00.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:00.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: Deploying daemon mds.b on smithi067 2024-09-13T18:15:00.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:14:59 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1526636454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:00.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.7:6840/4101588502,v1:172.21.15.7:6841/4101588502] up:boot 2024-09-13T18:15:00.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: fsmap 11 up:standby 2024-09-13T18:15:00.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:15:00.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:15:00.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:15:00.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:00.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: Deploying daemon mds.b on smithi067 2024-09-13T18:15:00.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:14:59 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1526636454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.7:6840/4101588502,v1:172.21.15.7:6841/4101588502] up:boot 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: fsmap 11 up:standby 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:00.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: Deploying daemon mds.b on smithi067 2024-09-13T18:15:00.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:14:59 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1526636454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:01.139 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:00 smithi067 ceph-mon[35103]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:01.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:00 smithi007 ceph-mon[30588]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:01.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:00 smithi116 ceph-mon[35109]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:01.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:15:01.747 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:15:01 smithi067 systemd[1]: Started Ceph mds.b for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:15:01.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.835+0000 7f8ea6c00640 1 -- 172.21.15.7:0/814476535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea00760b0 msgr2=0x7f8ea0076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:01.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.835+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/814476535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea00760b0 0x7f8ea0076510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009900 tx=0x7f8e8c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:01.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.836+0000 7f8ea6c00640 1 -- 172.21.15.7:0/814476535 shutdown_connections 2024-09-13T18:15:01.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.836+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/814476535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ea0076a50 0x7f8ea00772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:01.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.836+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/814476535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea00760b0 0x7f8ea0076510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:01.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.836+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/814476535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea0074e70 0x7f8ea0075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:01.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.836+0000 7f8ea6c00640 1 -- 172.21.15.7:0/814476535 >> 172.21.15.7:0/814476535 conn(0x7f8ea00fd580 msgr2=0x7f8ea00ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:01.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.836+0000 7f8ea6c00640 1 -- 172.21.15.7:0/814476535 shutdown_connections 2024-09-13T18:15:01.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.836+0000 7f8ea6c00640 1 -- 172.21.15.7:0/814476535 wait complete. 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 Processor -- start 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 -- start start 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0074e70 0x7f8ea019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ea00760b0 0x7f8ea019c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea0076a50 0x7f8ea01a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01a3ce0 con 0x7f8ea0076a50 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01a3e50 con 0x7f8ea00760b0 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01a4010 con 0x7f8ea0074e70 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea5800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0074e70 0x7f8ea019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea4e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ea00760b0 0x7f8ea019c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea6200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea0076a50 0x7f8ea01a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:01.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea5800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0074e70 0x7f8ea019c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:35936/0 (socket says 172.21.15.7:35936) 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea4e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ea00760b0 0x7f8ea019c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:39700/0 (socket says 172.21.15.7:39700) 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.837+0000 7f8ea5800640 1 -- 172.21.15.7:0/2871852898 learned_addr learned my addr 172.21.15.7:0/2871852898 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea5800640 1 -- 172.21.15.7:0/2871852898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ea00760b0 msgr2=0x7f8ea019c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea5800640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ea00760b0 0x7f8ea019c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea5800640 1 -- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea0076a50 msgr2=0x7f8ea01a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea5800640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea0076a50 0x7f8ea01a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea5800640 1 -- 172.21.15.7:0/2871852898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e94009490 con 0x7f8ea0074e70 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea5800640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0074e70 0x7f8ea019c1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400ea60 tx=0x7f8e9400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8e9e000640 1 -- 172.21.15.7:0/2871852898 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400cde0 con 0x7f8ea0074e70 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c009560 con 0x7f8ea0074e70 2024-09-13T18:15:01.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8e9e000640 1 -- 172.21.15.7:0/2871852898 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e940035f0 con 0x7f8ea0074e70 2024-09-13T18:15:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8e9e000640 1 -- 172.21.15.7:0/2871852898 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940044e0 con 0x7f8ea0074e70 2024-09-13T18:15:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.838+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea01a4640 con 0x7f8ea0074e70 2024-09-13T18:15:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.839+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea010e9b0 con 0x7f8ea0074e70 2024-09-13T18:15:01.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.841+0000 7f8e9e000640 1 -- 172.21.15.7:0/2871852898 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f8e94003a60 con 0x7f8ea0074e70 2024-09-13T18:15:01.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.842+0000 7f8e9e000640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e880a1090 0x7f8e880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.843+0000 7f8e9e000640 1 -- 172.21.15.7:0/2871852898 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8e94014070 con 0x7f8ea0074e70 2024-09-13T18:15:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.843+0000 7f8ea4e00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e880a1090 0x7f8e880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:01.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.843+0000 7f8ea4e00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e880a1090 0x7f8e880a3550 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c02a9e0 tx=0x7f8e8c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:01.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:01.846+0000 7f8e9e000640 1 -- 172.21.15.7:0/2871852898 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8e94096500 con 0x7f8ea0074e70 2024-09-13T18:15:02.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.070+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ea0111af0 con 0x7f8ea0074e70 2024-09-13T18:15:02.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.071+0000 7f8e9e000640 1 -- 172.21.15.7:0/2871852898 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9574 (secure 0 0 0) 0x7f8e94099b20 con 0x7f8ea0074e70 2024-09-13T18:15:02.074 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:02.075 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24466,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-09-13T18:15:02.075 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 13 2024-09-13T18:15:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e880a1090 msgr2=0x7f8e880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e880a1090 0x7f8e880a3550 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c02a9e0 tx=0x7f8e8c0314a0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0074e70 msgr2=0x7f8ea019c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0074e70 0x7f8ea019c1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400ea60 tx=0x7f8e9400ef20 comp rx=0 tx=0).stop 2024-09-13T18:15:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 shutdown_connections 2024-09-13T18:15:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e880a1090 0x7f8e880a3550 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ea0076a50 0x7f8ea01a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ea00760b0 0x7f8ea019c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 --2- 172.21.15.7:0/2871852898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ea0074e70 0x7f8ea019c1f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 >> 172.21.15.7:0/2871852898 conn(0x7f8ea00fd580 msgr2=0x7f8ea00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 shutdown_connections 2024-09-13T18:15:02.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.074+0000 7f8ea6c00640 1 -- 172.21.15.7:0/2871852898 wait complete. 2024-09-13T18:15:02.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:15:02.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 -- 172.21.15.7:0/3803947857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60102ff0 msgr2=0x7f3a60103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3803947857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60102ff0 0x7f3a60103470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009860 tx=0x7f3a4c02a340 comp rx=0 tx=0).stop 2024-09-13T18:15:02.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 -- 172.21.15.7:0/3803947857 shutdown_connections 2024-09-13T18:15:02.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3803947857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a601039b0 0x7f3a6010a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3803947857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60102ff0 0x7f3a60103470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3803947857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a60101e00 0x7f3a60102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 -- 172.21.15.7:0/3803947857 >> 172.21.15.7:0/3803947857 conn(0x7f3a600fd580 msgr2=0x7f3a600ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 -- 172.21.15.7:0/3803947857 shutdown_connections 2024-09-13T18:15:02.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.254+0000 7f3a65a00640 1 -- 172.21.15.7:0/3803947857 wait complete. 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.255+0000 7f3a65a00640 1 Processor -- start 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.255+0000 7f3a65a00640 1 -- start start 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60101e00 0x7f3a60197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a60102ff0 0x7f3a60198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a601039b0 0x7f3a6019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6019f8c0 con 0x7f3a60102ff0 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6019fa30 con 0x7f3a601039b0 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6019fbf0 con 0x7f3a60101e00 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60101e00 0x7f3a60197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a601039b0 0x7f3a6019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60101e00 0x7f3a60197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:35952/0 (socket says 172.21.15.7:35952) 2024-09-13T18:15:02.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 -- 172.21.15.7:0/3415316209 learned_addr learned my addr 172.21.15.7:0/3415316209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5f400640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a60102ff0 0x7f3a60198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 -- 172.21.15.7:0/3415316209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a601039b0 msgr2=0x7f3a6019f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a601039b0 0x7f3a6019f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 -- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a60102ff0 msgr2=0x7f3a60198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a60102ff0 0x7f3a60198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a5fe00640 1 -- 172.21.15.7:0/3415316209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c009490 con 0x7f3a60101e00 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.256+0000 7f3a65000640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a601039b0 0x7f3a6019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.257+0000 7f3a5fe00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60101e00 0x7f3a60197dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000e9f0 tx=0x7f3a5000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.257+0000 7f3a5cc00640 1 -- 172.21.15.7:0/3415316209 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000ccc0 con 0x7f3a60101e00 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.257+0000 7f3a5cc00640 1 -- 172.21.15.7:0/3415316209 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a5000ce20 con 0x7f3a60101e00 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.257+0000 7f3a5cc00640 1 -- 172.21.15.7:0/3415316209 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50010430 con 0x7f3a60101e00 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.257+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6019fed0 con 0x7f3a60101e00 2024-09-13T18:15:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.257+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a601a02a0 con 0x7f3a60101e00 2024-09-13T18:15:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.258+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a601092d0 con 0x7f3a60101e00 2024-09-13T18:15:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.260+0000 7f3a5cc00640 1 -- 172.21.15.7:0/3415316209 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f3a50003f20 con 0x7f3a60101e00 2024-09-13T18:15:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.261+0000 7f3a5cc00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3a440a1110 0x7f3a440a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.261+0000 7f3a5cc00640 1 -- 172.21.15.7:0/3415316209 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3a50014070 con 0x7f3a60101e00 2024-09-13T18:15:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.262+0000 7f3a5f400640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3a440a1110 0x7f3a440a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.262+0000 7f3a5f400640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3a440a1110 0x7f3a440a35d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009830 tx=0x7f3a4c0305a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:02.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.265+0000 7f3a5cc00640 1 -- 172.21.15.7:0/3415316209 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3a50096220 con 0x7f3a60101e00 2024-09-13T18:15:02.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.459+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a6002c4b0 con 0x7f3a60101e00 2024-09-13T18:15:02.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.460+0000 7f3a5cc00640 1 -- 172.21.15.7:0/3415316209 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f3a50099840 con 0x7f3a60101e00 2024-09-13T18:15:02.464 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:02.464 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":82,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:14:17.251749+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:15:02.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3a440a1110 msgr2=0x7f3a440a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3a440a1110 0x7f3a440a35d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009830 tx=0x7f3a4c0305a0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60101e00 msgr2=0x7f3a60197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60101e00 0x7f3a60197dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000e9f0 tx=0x7f3a5000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 shutdown_connections 2024-09-13T18:15:02.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3a440a1110 0x7f3a440a35d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a601039b0 0x7f3a6019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a60102ff0 0x7f3a60198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 --2- 172.21.15.7:0/3415316209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a60101e00 0x7f3a60197dd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 >> 172.21.15.7:0/3415316209 conn(0x7f3a600fd580 msgr2=0x7f3a601064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 shutdown_connections 2024-09-13T18:15:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.463+0000 7f3a65a00640 1 -- 172.21.15.7:0/3415316209 wait complete. 2024-09-13T18:15:02.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:15:02.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 -- 172.21.15.7:0/2595880200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 msgr2=0x7fbba8076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 --2- 172.21.15.7:0/2595880200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 0x7fbba8076510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009900 tx=0x7fbb9402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 -- 172.21.15.7:0/2595880200 shutdown_connections 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 --2- 172.21.15.7:0/2595880200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbba8076a50 0x7fbba80772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 --2- 172.21.15.7:0/2595880200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 0x7fbba8076510 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 --2- 172.21.15.7:0/2595880200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 0x7fbba8075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 -- 172.21.15.7:0/2595880200 >> 172.21.15.7:0/2595880200 conn(0x7fbba80fd730 msgr2=0x7fbba80ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:02.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 -- 172.21.15.7:0/2595880200 shutdown_connections 2024-09-13T18:15:02.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.645+0000 7fbbae400640 1 -- 172.21.15.7:0/2595880200 wait complete. 2024-09-13T18:15:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.646+0000 7fbbae400640 1 Processor -- start 2024-09-13T18:15:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.646+0000 7fbbae400640 1 -- start start 2024-09-13T18:15:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbbae400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 0x7fbba819c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbbae400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 0x7fbba819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbbae400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbba8076a50 0x7fbba81a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbbae400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba81a3ec0 con 0x7fbba8076a50 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbbae400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba81a4030 con 0x7fbba80760b0 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbbae400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba81a41f0 con 0x7fbba8074e70 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 0x7fbba819c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 0x7fbba819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 0x7fbba819c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:39740/0 (socket says 172.21.15.7:39740) 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 0x7fbba819c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:35970/0 (socket says 172.21.15.7:35970) 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba6a00640 1 -- 172.21.15.7:0/1592176260 learned_addr learned my addr 172.21.15.7:0/1592176260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7e00640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbba8076a50 0x7fbba81a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7400640 1 -- 172.21.15.7:0/1592176260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 msgr2=0x7fbba819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 0x7fbba819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7400640 1 -- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbba8076a50 msgr2=0x7fbba81a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbba8076a50 0x7fbba81a3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.647+0000 7fbba7400640 1 -- 172.21.15.7:0/1592176260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0009840 con 0x7fbba8074e70 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.648+0000 7fbba7400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 0x7fbba819c3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800e9f0 tx=0x7fbb9800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.648+0000 7fbb9fe00640 1 -- 172.21.15.7:0/1592176260 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800ccc0 con 0x7fbba8074e70 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.648+0000 7fbb9fe00640 1 -- 172.21.15.7:0/1592176260 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb9800ce20 con 0x7fbba8074e70 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.648+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94009560 con 0x7fbba8074e70 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.648+0000 7fbb9fe00640 1 -- 172.21.15.7:0/1592176260 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98004a00 con 0x7fbba8074e70 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.648+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba81a4850 con 0x7fbba8074e70 2024-09-13T18:15:02.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.649+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba810eb70 con 0x7fbba8074e70 2024-09-13T18:15:02.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.651+0000 7fbb9fe00640 1 -- 172.21.15.7:0/1592176260 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fbb98005020 con 0x7fbba8074e70 2024-09-13T18:15:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.652+0000 7fbb9fe00640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbb8c0a1110 0x7fbb8c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.652+0000 7fbb9fe00640 1 -- 172.21.15.7:0/1592176260 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbb98014070 con 0x7fbba8074e70 2024-09-13T18:15:02.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.652+0000 7fbba6a00640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbb8c0a1110 0x7fbb8c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:02.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.653+0000 7fbba6a00640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbb8c0a1110 0x7fbb8c0a35d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbba819d8e0 tx=0x7fbb94005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:02.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.656+0000 7fbb9fe00640 1 -- 172.21.15.7:0/1592176260 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbb98096000 con 0x7fbba8074e70 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] up:boot 2024-09-13T18:15:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: fsmap 12 up:standby 2024-09-13T18:15:02.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:15:02.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2871852898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:02 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3415316209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] up:boot 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: fsmap 12 up:standby 2024-09-13T18:15:02.830 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:15:02.831 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2871852898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.831 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:02 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3415316209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.837+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbba8111d30 con 0x7fbba8074e70 2024-09-13T18:15:02.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.837+0000 7fbb9fe00640 1 -- 172.21.15.7:0/1592176260 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb98099620 con 0x7fbba8074e70 2024-09-13T18:15:02.841 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:15:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbb8c0a1110 msgr2=0x7fbb8c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbb8c0a1110 0x7fbb8c0a35d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbba819d8e0 tx=0x7fbb94005780 comp rx=0 tx=0).stop 2024-09-13T18:15:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 msgr2=0x7fbba819c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 0x7fbba819c3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800e9f0 tx=0x7fbb9800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 shutdown_connections 2024-09-13T18:15:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbb8c0a1110 0x7fbb8c0a35d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbba8076a50 0x7fbba81a3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbba80760b0 0x7fbba819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 --2- 172.21.15.7:0/1592176260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbba8074e70 0x7fbba819c3d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 >> 172.21.15.7:0/1592176260 conn(0x7fbba80fd730 msgr2=0x7fbba80fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 shutdown_connections 2024-09-13T18:15:02.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:02.840+0000 7fbbae400640 1 -- 172.21.15.7:0/1592176260 wait complete. 2024-09-13T18:15:02.859 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] up:boot 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: fsmap 12 up:standby 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2871852898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:02.971 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:02 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3415316209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.020+0000 7f4679800640 1 -- 172.21.15.7:0/54450839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674101f10 msgr2=0x7f4674102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.020+0000 7f4679800640 1 --2- 172.21.15.7:0/54450839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674101f10 0x7f4674102310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4664009900 tx=0x7f466402a3e0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.020+0000 7f4679800640 1 -- 172.21.15.7:0/54450839 shutdown_connections 2024-09-13T18:15:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.020+0000 7f4679800640 1 --2- 172.21.15.7:0/54450839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674103a20 0x7f467410a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.020+0000 7f4679800640 1 --2- 172.21.15.7:0/54450839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4674103060 0x7f46741034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.020+0000 7f4679800640 1 --2- 172.21.15.7:0/54450839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674101f10 0x7f4674102310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.021+0000 7f4679800640 1 -- 172.21.15.7:0/54450839 >> 172.21.15.7:0/54450839 conn(0x7f46740fd690 msgr2=0x7f46740ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.021+0000 7f4679800640 1 -- 172.21.15.7:0/54450839 shutdown_connections 2024-09-13T18:15:03.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.021+0000 7f4679800640 1 -- 172.21.15.7:0/54450839 wait complete. 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.021+0000 7f4679800640 1 Processor -- start 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4679800640 1 -- start start 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4679800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674101f10 0x7f4674197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4679800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4674103060 0x7f46741983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4679800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674103a20 0x7f467419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4679800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467419f960 con 0x7f4674103060 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4679800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467419fad0 con 0x7f4674103a20 2024-09-13T18:15:03.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4679800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467419fc90 con 0x7f4674101f10 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4672a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674101f10 0x7f4674197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4672a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674101f10 0x7f4674197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:35980/0 (socket says 172.21.15.7:35980) 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4672a00640 1 -- 172.21.15.7:0/360584780 learned_addr learned my addr 172.21.15.7:0/360584780 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4673400640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674103a20 0x7f467419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.022+0000 7f4672000640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4674103060 0x7f46741983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4672a00640 1 -- 172.21.15.7:0/360584780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674103a20 msgr2=0x7f467419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4672a00640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674103a20 0x7f467419f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4672a00640 1 -- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4674103060 msgr2=0x7f46741983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4672a00640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4674103060 0x7f46741983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4672a00640 1 -- 172.21.15.7:0/360584780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009490 con 0x7f4674101f10 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4672000640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4674103060 0x7f46741983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4672a00640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674101f10 0x7f4674197e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4664009a20 tx=0x7f4664005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:03.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f466b400640 1 -- 172.21.15.7:0/360584780 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664004c10 con 0x7f4674101f10 2024-09-13T18:15:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f466b400640 1 -- 172.21.15.7:0/360584780 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4664004d70 con 0x7f4674101f10 2024-09-13T18:15:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4664009560 con 0x7f4674101f10 2024-09-13T18:15:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.023+0000 7f466b400640 1 -- 172.21.15.7:0/360584780 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664031ae0 con 0x7f4674101f10 2024-09-13T18:15:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.024+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46741a0180 con 0x7f4674101f10 2024-09-13T18:15:03.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.025+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4674109360 con 0x7f4674101f10 2024-09-13T18:15:03.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.028+0000 7f466b400640 1 -- 172.21.15.7:0/360584780 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f4664031c40 con 0x7f4674101f10 2024-09-13T18:15:03.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.029+0000 7f466b400640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46580a1090 0x7f46580a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.029+0000 7f466b400640 1 -- 172.21.15.7:0/360584780 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f46640ed3a0 con 0x7f4674101f10 2024-09-13T18:15:03.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.030+0000 7f4672000640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46580a1090 0x7f46580a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.030+0000 7f466b400640 1 -- 172.21.15.7:0/360584780 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f46640b6fe0 con 0x7f4674101f10 2024-09-13T18:15:03.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.031+0000 7f4672000640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46580a1090 0x7f46580a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4674199380 tx=0x7f4660005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:03.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.236+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f467410d810 con 0x7f4674101f10 2024-09-13T18:15:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.237+0000 7f466b400640 1 -- 172.21.15.7:0/360584780 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f46640ba600 con 0x7f4674101f10 2024-09-13T18:15:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:03.240 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-09-13T18:15:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:15:03.240 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-09-13T18:15:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-09-13T18:15:03.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:15:03.241 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-09-13T18:15:03.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46580a1090 msgr2=0x7f46580a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46580a1090 0x7f46580a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4674199380 tx=0x7f4660005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:03.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674101f10 msgr2=0x7f4674197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674101f10 0x7f4674197e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4664009a20 tx=0x7f4664005620 comp rx=0 tx=0).stop 2024-09-13T18:15:03.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 shutdown_connections 2024-09-13T18:15:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46580a1090 0x7f46580a3550 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4674103a20 0x7f467419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4674103060 0x7f46741983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 --2- 172.21.15.7:0/360584780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4674101f10 0x7f4674197e70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 >> 172.21.15.7:0/360584780 conn(0x7f46740fd690 msgr2=0x7f4674106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 shutdown_connections 2024-09-13T18:15:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.239+0000 7f4679800640 1 -- 172.21.15.7:0/360584780 wait complete. 2024-09-13T18:15:03.259 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:15:03.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 -- 172.21.15.7:0/4252170048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad18102f70 msgr2=0x7fad18105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 --2- 172.21.15.7:0/4252170048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad18102f70 0x7fad18105360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad04009900 tx=0x7fad0402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 -- 172.21.15.7:0/4252170048 shutdown_connections 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 --2- 172.21.15.7:0/4252170048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad181058a0 0x7fad18107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 --2- 172.21.15.7:0/4252170048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad18102f70 0x7fad18105360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 --2- 172.21.15.7:0/4252170048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18100640 0x7fad18102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 -- 172.21.15.7:0/4252170048 >> 172.21.15.7:0/4252170048 conn(0x7fad180fa220 msgr2=0x7fad180fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 -- 172.21.15.7:0/4252170048 shutdown_connections 2024-09-13T18:15:03.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.429+0000 7fad1d000640 1 -- 172.21.15.7:0/4252170048 wait complete. 2024-09-13T18:15:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.430+0000 7fad1d000640 1 Processor -- start 2024-09-13T18:15:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.430+0000 7fad1d000640 1 -- start start 2024-09-13T18:15:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad1d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad18100640 0x7fad18195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad1d000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18102f70 0x7fad18196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad1d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad181058a0 0x7fad1819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad1d000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1819d720 con 0x7fad18100640 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad1d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1819d890 con 0x7fad181058a0 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad1d000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1819da50 con 0x7fad18102f70 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad18100640 0x7fad18195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad18100640 0x7fad18195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48682/0 (socket says 172.21.15.7:48682) 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 -- 172.21.15.7:0/3893452435 learned_addr learned my addr 172.21.15.7:0/3893452435 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad16a00640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18102f70 0x7fad18196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17e00640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad181058a0 0x7fad1819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 -- 172.21.15.7:0/3893452435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18102f70 msgr2=0x7fad18196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18102f70 0x7fad18196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 -- 172.21.15.7:0/3893452435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad181058a0 msgr2=0x7fad1819d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad181058a0 0x7fad1819d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17400640 1 -- 172.21.15.7:0/3893452435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad04009560 con 0x7fad18100640 2024-09-13T18:15:03.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.431+0000 7fad17e00640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad181058a0 0x7fad1819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.432+0000 7fad17400640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad18100640 0x7fad18195c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fad0800e9f0 tx=0x7fad0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.432+0000 7fad0fe00640 1 -- 172.21.15.7:0/3893452435 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08009720 con 0x7fad18100640 2024-09-13T18:15:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.432+0000 7fad0fe00640 1 -- 172.21.15.7:0/3893452435 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad0800cd80 con 0x7fad18100640 2024-09-13T18:15:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.432+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1819dd30 con 0x7fad18100640 2024-09-13T18:15:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.432+0000 7fad0fe00640 1 -- 172.21.15.7:0/3893452435 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08010430 con 0x7fad18100640 2024-09-13T18:15:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.432+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1819e190 con 0x7fad18100640 2024-09-13T18:15:03.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.433+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad180fbd10 con 0x7fad18100640 2024-09-13T18:15:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.435+0000 7fad0fe00640 1 -- 172.21.15.7:0/3893452435 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fad08005000 con 0x7fad18100640 2024-09-13T18:15:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.436+0000 7fad0fe00640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7facfc0a1090 0x7facfc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.437+0000 7fad0fe00640 1 -- 172.21.15.7:0/3893452435 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fad08014070 con 0x7fad18100640 2024-09-13T18:15:03.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.437+0000 7fad16a00640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7facfc0a1090 0x7facfc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:03.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.438+0000 7fad16a00640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7facfc0a1090 0x7facfc0a3550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad04005ab0 tx=0x7fad040314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:03.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.439+0000 7fad0fe00640 1 -- 172.21.15.7:0/3893452435 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad08096590 con 0x7fad18100640 2024-09-13T18:15:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:03.672+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fad1810b4b0 con 0x7fad18100640 2024-09-13T18:15:03.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1592176260' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:15:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/360584780' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T18:15:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:03 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1592176260' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/360584780' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:03 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:03.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1592176260' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:15:03.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/360584780' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T18:15:03.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:03.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:03 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.543+0000 7fad0fe00640 1 -- 172.21.15.7:0/3893452435 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7fad08094e60 con 0x7fad18100640 2024-09-13T18:15:04.546 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-09-13T18:15:04.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7facfc0a1090 msgr2=0x7facfc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:04.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7facfc0a1090 0x7facfc0a3550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad04005ab0 tx=0x7fad040314a0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad18100640 msgr2=0x7fad18195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:04.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad18100640 0x7fad18195c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fad0800e9f0 tx=0x7fad0800edf0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 shutdown_connections 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7facfc0a1090 0x7facfc0a3550 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad181058a0 0x7fad1819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18102f70 0x7fad18196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 --2- 172.21.15.7:0/3893452435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad18100640 0x7fad18195c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 >> 172.21.15.7:0/3893452435 conn(0x7fad180fa220 msgr2=0x7fad18100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.549+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 shutdown_connections 2024-09-13T18:15:04.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.550+0000 7fad1d000640 1 -- 172.21.15.7:0/3893452435 wait complete. 2024-09-13T18:15:04.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:15:04.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 -- 172.21.15.7:0/2497756010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 msgr2=0x7fec0c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 --2- 172.21.15.7:0/2497756010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 0x7fec0c107d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec04009be0 tx=0x7fec0402a6c0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 -- 172.21.15.7:0/2497756010 shutdown_connections 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 --2- 172.21.15.7:0/2497756010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 0x7fec0c107d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 --2- 172.21.15.7:0/2497756010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c102f70 0x7fec0c105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 --2- 172.21.15.7:0/2497756010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 0x7fec0c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 -- 172.21.15.7:0/2497756010 >> 172.21.15.7:0/2497756010 conn(0x7fec0c0fa220 msgr2=0x7fec0c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 -- 172.21.15.7:0/2497756010 shutdown_connections 2024-09-13T18:15:04.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.743+0000 7fec0b200640 1 -- 172.21.15.7:0/2497756010 wait complete. 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.744+0000 7fec0b200640 1 Processor -- start 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.744+0000 7fec0b200640 1 -- start start 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.744+0000 7fec0b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 0x7fec0c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.744+0000 7fec0b200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c102f70 0x7fec0c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.744+0000 7fec0b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 0x7fec0c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec0b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c19f9a0 con 0x7fec0c100640 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec0b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c19fb10 con 0x7fec0c1058a0 2024-09-13T18:15:04.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec0b200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c19fcd0 con 0x7fec0c102f70 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 0x7fec0c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec0a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 0x7fec0c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c102f70 0x7fec0c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 0x7fec0c197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60328/0 (socket says 172.21.15.7:60328) 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09e00640 1 -- 172.21.15.7:0/931609921 learned_addr learned my addr 172.21.15.7:0/931609921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09400640 1 -- 172.21.15.7:0/931609921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 msgr2=0x7fec0c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09400640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 0x7fec0c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09400640 1 -- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 msgr2=0x7fec0c197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09400640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 0x7fec0c197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09400640 1 -- 172.21.15.7:0/931609921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009560 con 0x7fec0c102f70 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.745+0000 7fec09e00640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 0x7fec0c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.746+0000 7fec09400640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c102f70 0x7fec0c1983f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febf800e9c0 tx=0x7febf800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.746+0000 7fec02a00640 1 -- 172.21.15.7:0/931609921 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800ccc0 con 0x7fec0c102f70 2024-09-13T18:15:04.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.746+0000 7fec02a00640 1 -- 172.21.15.7:0/931609921 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febf800ce20 con 0x7fec0c102f70 2024-09-13T18:15:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.746+0000 7fec02a00640 1 -- 172.21.15.7:0/931609921 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8004a00 con 0x7fec0c102f70 2024-09-13T18:15:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.746+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec04009840 con 0x7fec0c102f70 2024-09-13T18:15:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.746+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c1a0250 con 0x7fec0c102f70 2024-09-13T18:15:04.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.747+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c103350 con 0x7fec0c102f70 2024-09-13T18:15:04.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.749+0000 7fec02a00640 1 -- 172.21.15.7:0/931609921 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7febf8004b60 con 0x7fec0c102f70 2024-09-13T18:15:04.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.750+0000 7fec02a00640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febf00a1090 0x7febf00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:04.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.750+0000 7fec02a00640 1 -- 172.21.15.7:0/931609921 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7febf8014070 con 0x7fec0c102f70 2024-09-13T18:15:04.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.751+0000 7fec09e00640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febf00a1090 0x7febf00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:04.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.751+0000 7fec09e00640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febf00a1090 0x7febf00a3550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febfc005c80 tx=0x7febfc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.754+0000 7fec02a00640 1 -- 172.21.15.7:0/931609921 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7febf8095fc0 con 0x7fec0c102f70 2024-09-13T18:15:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:04 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3893452435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:15:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:15:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:04 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:15:04.913 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:04 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3893452435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:15:04.914 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.914 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.914 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:04.914 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:15:04.914 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.914 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:04 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:15:04.921 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:04 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3893452435' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:15:04.921 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.921 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.921 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:04.921 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:15:04.921 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:04.921 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:04 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:15:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:04.958+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fec0c10b6c0 con 0x7fec0c102f70 2024-09-13T18:15:05.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.553+0000 7fec02a00640 1 -- 172.21.15.7:0/931609921 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7febf80995e0 con 0x7fec0c102f70 2024-09-13T18:15:05.557 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-09-13T18:15:05.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.558+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febf00a1090 msgr2=0x7febf00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:05.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.558+0000 7fec0b200640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febf00a1090 0x7febf00a3550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febfc005c80 tx=0x7febfc009260 comp rx=0 tx=0).stop 2024-09-13T18:15:05.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.558+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c102f70 msgr2=0x7fec0c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:05.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.558+0000 7fec0b200640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c102f70 0x7fec0c1983f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febf800e9c0 tx=0x7febf800ee80 comp rx=0 tx=0).stop 2024-09-13T18:15:05.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.559+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 shutdown_connections 2024-09-13T18:15:05.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.559+0000 7fec0b200640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febf00a1090 0x7febf00a3550 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.559+0000 7fec0b200640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec0c1058a0 0x7fec0c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.559+0000 7fec0b200640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec0c102f70 0x7fec0c1983f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.559+0000 7fec0b200640 1 --2- 172.21.15.7:0/931609921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec0c100640 0x7fec0c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.559+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 >> 172.21.15.7:0/931609921 conn(0x7fec0c0fa220 msgr2=0x7fec0c0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:05.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.560+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 shutdown_connections 2024-09-13T18:15:05.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.560+0000 7fec0b200640 1 -- 172.21.15.7:0/931609921 wait complete. 2024-09-13T18:15:05.589 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:15:05.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 -- 172.21.15.7:0/1959211996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac100810 msgr2=0x7f42ac102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:05.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 --2- 172.21.15.7:0/1959211996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac100810 0x7f42ac102c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f429c009900 tx=0x7f429c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 -- 172.21.15.7:0/1959211996 shutdown_connections 2024-09-13T18:15:05.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 --2- 172.21.15.7:0/1959211996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac105a70 0x7f42ac107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 --2- 172.21.15.7:0/1959211996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42ac103140 0x7f42ac105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 --2- 172.21.15.7:0/1959211996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac100810 0x7f42ac102c00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 -- 172.21.15.7:0/1959211996 >> 172.21.15.7:0/1959211996 conn(0x7f42ac0fa3f0 msgr2=0x7f42ac0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:05.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 -- 172.21.15.7:0/1959211996 shutdown_connections 2024-09-13T18:15:05.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.755+0000 7f42b1400640 1 -- 172.21.15.7:0/1959211996 wait complete. 2024-09-13T18:15:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.756+0000 7f42b1400640 1 Processor -- start 2024-09-13T18:15:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42b1400640 1 -- start start 2024-09-13T18:15:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42b1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42ac100810 0x7f42ac198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42b1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac103140 0x7f42ac1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42b1400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac105a70 0x7f42ac19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42b1400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac19fb50 con 0x7f42ac100810 2024-09-13T18:15:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42b1400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac19fcc0 con 0x7f42ac103140 2024-09-13T18:15:05.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42b1400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac19fe80 con 0x7f42ac105a70 2024-09-13T18:15:05.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42a9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac103140 0x7f42ac1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:05.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42a9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac103140 0x7f42ac1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:50454/0 (socket says 172.21.15.7:50454) 2024-09-13T18:15:05.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42a9e00640 1 -- 172.21.15.7:0/1899086954 learned_addr learned my addr 172.21.15.7:0/1899086954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:05.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42aa800640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42ac100810 0x7f42ac198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.757+0000 7f42ab200640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac105a70 0x7f42ac19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.758+0000 7f42a9e00640 1 -- 172.21.15.7:0/1899086954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac105a70 msgr2=0x7f42ac19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.758+0000 7f42a9e00640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac105a70 0x7f42ac19f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.758+0000 7f42a9e00640 1 -- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42ac100810 msgr2=0x7f42ac198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.758+0000 7f42a9e00640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42ac100810 0x7f42ac198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.758+0000 7f42a9e00640 1 -- 172.21.15.7:0/1899086954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4009840 con 0x7f42ac103140 2024-09-13T18:15:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.758+0000 7f42a9e00640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac103140 0x7f42ac1985a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9c0 tx=0x7f429800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:05.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.759+0000 7f42a3400640 1 -- 172.21.15.7:0/1899086954 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298009700 con 0x7f42ac103140 2024-09-13T18:15:05.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.759+0000 7f42a3400640 1 -- 172.21.15.7:0/1899086954 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42980054e0 con 0x7f42ac103140 2024-09-13T18:15:05.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.759+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c009560 con 0x7f42ac103140 2024-09-13T18:15:05.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.759+0000 7f42a3400640 1 -- 172.21.15.7:0/1899086954 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298004e70 con 0x7f42ac103140 2024-09-13T18:15:05.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.759+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac1a0530 con 0x7f42ac103140 2024-09-13T18:15:05.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.761+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac1075b0 con 0x7f42ac103140 2024-09-13T18:15:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.762+0000 7f42a3400640 1 -- 172.21.15.7:0/1899086954 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f4298005020 con 0x7f42ac103140 2024-09-13T18:15:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.763+0000 7f42a3400640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f42900a1110 0x7f42900a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.764+0000 7f42a3400640 1 -- 172.21.15.7:0/1899086954 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f4298014070 con 0x7f42ac103140 2024-09-13T18:15:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.764+0000 7f42aa800640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f42900a1110 0x7f42900a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:05.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.765+0000 7f42aa800640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f42900a1110 0x7f42900a35d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f429c005ab0 tx=0x7f429c005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:05.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.767+0000 7f42a3400640 1 -- 172.21.15.7:0/1899086954 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4298096490 con 0x7f42ac103140 2024-09-13T18:15:05.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:05 smithi116 ceph-mon[35109]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:05.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:05 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3893452435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T18:15:05.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:05 smithi116 ceph-mon[35109]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T18:15:05.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:05 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/931609921' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:15:05.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:05 smithi116 ceph-mon[35109]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:15:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:05 smithi067 ceph-mon[35103]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:05 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3893452435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T18:15:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:05 smithi067 ceph-mon[35103]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T18:15:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:05 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/931609921' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:15:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:05 smithi067 ceph-mon[35103]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:15:06.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:05.999+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f42ac10b9d0 con 0x7f42ac103140 2024-09-13T18:15:06.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.007+0000 7f42a3400640 1 -- 172.21.15.7:0/1899086954 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4298099ab0 con 0x7f42ac103140 2024-09-13T18:15:06.012 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:15:06.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.012+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f42900a1110 msgr2=0x7f42900a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.012+0000 7f42b1400640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f42900a1110 0x7f42900a35d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f429c005ab0 tx=0x7f429c005780 comp rx=0 tx=0).stop 2024-09-13T18:15:06.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac103140 msgr2=0x7f42ac1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac103140 0x7f42ac1985a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9c0 tx=0x7f429800edc0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 shutdown_connections 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f42900a1110 0x7f42900a35d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac105a70 0x7f42ac19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42ac103140 0x7f42ac1985a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 --2- 172.21.15.7:0/1899086954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42ac100810 0x7f42ac198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.013+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 >> 172.21.15.7:0/1899086954 conn(0x7f42ac0fa3f0 msgr2=0x7f42ac0fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.014+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 shutdown_connections 2024-09-13T18:15:06.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.014+0000 7f42b1400640 1 -- 172.21.15.7:0/1899086954 wait complete. 2024-09-13T18:15:06.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:05 smithi007 ceph-mon[30588]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:06.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:05 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3893452435' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T18:15:06.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:05 smithi007 ceph-mon[30588]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T18:15:06.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:05 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/931609921' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:15:06.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:05 smithi007 ceph-mon[30588]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:15:06.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 -- 172.21.15.7:0/830082136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb00102fb0 msgr2=0x7feb001053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 --2- 172.21.15.7:0/830082136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb00102fb0 0x7feb001053a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feaec009900 tx=0x7feaec02a400 comp rx=0 tx=0).stop 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 -- 172.21.15.7:0/830082136 shutdown_connections 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 --2- 172.21.15.7:0/830082136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb001058e0 0x7feb00107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 --2- 172.21.15.7:0/830082136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb00102fb0 0x7feb001053a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 --2- 172.21.15.7:0/830082136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 0x7feb00102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 -- 172.21.15.7:0/830082136 >> 172.21.15.7:0/830082136 conn(0x7feb000fa280 msgr2=0x7feb000fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 -- 172.21.15.7:0/830082136 shutdown_connections 2024-09-13T18:15:06.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.224+0000 7feb05800640 1 -- 172.21.15.7:0/830082136 wait complete. 2024-09-13T18:15:06.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.225+0000 7feb05800640 1 Processor -- start 2024-09-13T18:15:06.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.225+0000 7feb05800640 1 -- start start 2024-09-13T18:15:06.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.225+0000 7feb05800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 0x7feb000ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.225+0000 7feb05800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb00102fb0 0x7feb000fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.225+0000 7feb05800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb001058e0 0x7feb000feb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.225+0000 7feb05800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb000ff2d0 con 0x7feb001058e0 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb05800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb000ff440 con 0x7feb00100680 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb05800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0019fd20 con 0x7feb00102fb0 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb04e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb001058e0 0x7feb000feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feaffe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 0x7feb000ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feaffe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 0x7feb000ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:50478/0 (socket says 172.21.15.7:50478) 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb04e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb001058e0 0x7feb000feb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60366/0 (socket says 172.21.15.7:60366) 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feaffe00640 1 -- 172.21.15.7:0/2715639468 learned_addr learned my addr 172.21.15.7:0/2715639468 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feaff400640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb00102fb0 0x7feb000fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb04e00640 1 -- 172.21.15.7:0/2715639468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb00102fb0 msgr2=0x7feb000fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb04e00640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb00102fb0 0x7feb000fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb04e00640 1 -- 172.21.15.7:0/2715639468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 msgr2=0x7feb000ffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb04e00640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 0x7feb000ffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feb04e00640 1 -- 172.21.15.7:0/2715639468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec009560 con 0x7feb001058e0 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.226+0000 7feaffe00640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 0x7feb000ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.227+0000 7feb04e00640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb001058e0 0x7feb000feb70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009fd0 tx=0x7feaf800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.227+0000 7feafcc00640 1 -- 172.21.15.7:0/2715639468 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800ce20 con 0x7feb001058e0 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.227+0000 7feafcc00640 1 -- 172.21.15.7:0/2715639468 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feaf8005020 con 0x7feb001058e0 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.227+0000 7feafcc00640 1 -- 172.21.15.7:0/2715639468 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8010670 con 0x7feb001058e0 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.227+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0019ffd0 con 0x7feb001058e0 2024-09-13T18:15:06.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.227+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb001a0400 con 0x7feb001058e0 2024-09-13T18:15:06.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.228+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb000fbd70 con 0x7feb001058e0 2024-09-13T18:15:06.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.232+0000 7feafcc00640 1 -- 172.21.15.7:0/2715639468 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7feaf8005450 con 0x7feb001058e0 2024-09-13T18:15:06.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.233+0000 7feafcc00640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7feae40a1090 0x7feae40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.233+0000 7feafcc00640 1 -- 172.21.15.7:0/2715639468 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feaf8014070 con 0x7feb001058e0 2024-09-13T18:15:06.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.233+0000 7feaffe00640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7feae40a1090 0x7feae40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.234+0000 7feaffe00640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7feae40a1090 0x7feae40a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feaf0011550 tx=0x7feaf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:06.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.238+0000 7feafcc00640 1 -- 172.21.15.7:0/2715639468 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feaf80966d0 con 0x7feb001058e0 2024-09-13T18:15:06.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.464+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb0010b550 con 0x7feb001058e0 2024-09-13T18:15:06.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.465+0000 7feafcc00640 1 -- 172.21.15.7:0/2715639468 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22002 (secure 0 0 0) 0x7feaf8099cf0 con 0x7feb001058e0 2024-09-13T18:15:06.469 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:06.469 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:15:06.002280+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:15:06.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7feae40a1090 msgr2=0x7feae40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7feae40a1090 0x7feae40a3550 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feaf0011550 tx=0x7feaf0005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:06.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb001058e0 msgr2=0x7feb000feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb001058e0 0x7feb000feb70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009fd0 tx=0x7feaf800ef10 comp rx=0 tx=0).stop 2024-09-13T18:15:06.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 shutdown_connections 2024-09-13T18:15:06.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7feae40a1090 0x7feae40a3550 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb001058e0 0x7feb000feb70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb00102fb0 0x7feb000fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 --2- 172.21.15.7:0/2715639468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb00100680 0x7feb000ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 >> 172.21.15.7:0/2715639468 conn(0x7feb000fa280 msgr2=0x7feb00100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:06.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 shutdown_connections 2024-09-13T18:15:06.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.468+0000 7feb05800640 1 -- 172.21.15.7:0/2715639468 wait complete. 2024-09-13T18:15:06.488 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 -- 172.21.15.7:0/1951964989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63381031f0 msgr2=0x7f6338103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 --2- 172.21.15.7:0/1951964989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63381031f0 0x7f6338103670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6320009900 tx=0x7f632002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 -- 172.21.15.7:0/1951964989 shutdown_connections 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 --2- 172.21.15.7:0/1951964989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6338103bb0 0x7f633810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 --2- 172.21.15.7:0/1951964989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63381031f0 0x7f6338103670 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 --2- 172.21.15.7:0/1951964989 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338102000 0x7f6338102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 -- 172.21.15.7:0/1951964989 >> 172.21.15.7:0/1951964989 conn(0x7f63380fd760 msgr2=0x7f63380ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 -- 172.21.15.7:0/1951964989 shutdown_connections 2024-09-13T18:15:06.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.642+0000 7f633f200640 1 -- 172.21.15.7:0/1951964989 wait complete. 2024-09-13T18:15:06.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.643+0000 7f633f200640 1 Processor -- start 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.643+0000 7f633f200640 1 -- start start 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6338102000 0x7f6338197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63381031f0 0x7f6338198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633f200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338103bb0 0x7f633819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633819fab0 con 0x7f6338102000 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633819fc20 con 0x7f63381031f0 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633f200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633819fde0 con 0x7f6338103bb0 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f6337e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6338102000 0x7f6338197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338103bb0 0x7f633819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f632fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63381031f0 0x7f6338198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f6337e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6338102000 0x7f6338197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60384/0 (socket says 172.21.15.7:60384) 2024-09-13T18:15:06.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f6337e00640 1 -- 172.21.15.7:0/1917998303 learned_addr learned my addr 172.21.15.7:0/1917998303 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f632fe00640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63381031f0 0x7f6338198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:50494/0 (socket says 172.21.15.7:50494) 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633d200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338103bb0 0x7f633819f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:47896/0 (socket says 172.21.15.7:47896) 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633d200640 1 -- 172.21.15.7:0/1917998303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63381031f0 msgr2=0x7f6338198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633d200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63381031f0 0x7f6338198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633d200640 1 -- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6338102000 msgr2=0x7f6338197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633d200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6338102000 0x7f6338197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.644+0000 7f633d200640 1 -- 172.21.15.7:0/1917998303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328009490 con 0x7f6338103bb0 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.645+0000 7f633d200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338103bb0 0x7f633819f570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f633000ec50 tx=0x7f633000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.645+0000 7f6335600640 1 -- 172.21.15.7:0/1917998303 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330003b70 con 0x7f6338103bb0 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.645+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6330009840 con 0x7f6338103bb0 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.645+0000 7f6335600640 1 -- 172.21.15.7:0/1917998303 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f633000ce70 con 0x7f6338103bb0 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.645+0000 7f6335600640 1 -- 172.21.15.7:0/1917998303 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330010690 con 0x7f6338103bb0 2024-09-13T18:15:06.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.645+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6320009560 con 0x7f6338103bb0 2024-09-13T18:15:06.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.646+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338109530 con 0x7f6338103bb0 2024-09-13T18:15:06.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.649+0000 7f6335600640 1 -- 172.21.15.7:0/1917998303 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f6330004020 con 0x7f6338103bb0 2024-09-13T18:15:06.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.650+0000 7f6335600640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f631c0a1090 0x7f631c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:06.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.650+0000 7f6335600640 1 -- 172.21.15.7:0/1917998303 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6330014070 con 0x7f6338103bb0 2024-09-13T18:15:06.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.650+0000 7f6337e00640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f631c0a1090 0x7f631c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:06.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.650+0000 7f6337e00640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f631c0a1090 0x7f631c0a3550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f63280058c0 tx=0x7f6328005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:06.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.653+0000 7f6335600640 1 -- 172.21.15.7:0/1917998303 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f63300967a0 con 0x7f6338103bb0 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1899086954' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:15:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:06 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2715639468' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:06.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.832+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f633810d8b0 con 0x7f6338103bb0 2024-09-13T18:15:06.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.835+0000 7f6335600640 1 -- 172.21.15.7:0/1917998303 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22002 (secure 0 0 0) 0x7f6330099dc0 con 0x7f6338103bb0 2024-09-13T18:15:06.838 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:06.838 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:15:06.002280+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:15:06.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.836+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f631c0a1090 msgr2=0x7f631c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.836+0000 7f633f200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f631c0a1090 0x7f631c0a3550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f63280058c0 tx=0x7f6328005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:06.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.836+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338103bb0 msgr2=0x7f633819f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:06.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.836+0000 7f633f200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338103bb0 0x7f633819f570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f633000ec50 tx=0x7f633000c6a0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 shutdown_connections 2024-09-13T18:15:06.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f631c0a1090 0x7f631c0a3550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338103bb0 0x7f633819f570 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63381031f0 0x7f6338198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 --2- 172.21.15.7:0/1917998303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6338102000 0x7f6338197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:06.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 >> 172.21.15.7:0/1917998303 conn(0x7f63380fd760 msgr2=0x7f6338106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:06.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 shutdown_connections 2024-09-13T18:15:06.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:06.837+0000 7f633f200640 1 -- 172.21.15.7:0/1917998303 wait complete. 2024-09-13T18:15:06.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1899086954' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:15:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:06 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2715639468' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T18:15:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T18:15:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1899086954' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:15:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:15:06.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:06 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2715639468' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:07.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.017+0000 7f3bb8800640 1 -- 172.21.15.7:0/3657610277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb0101fd0 msgr2=0x7f3bb01023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:07.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.017+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3657610277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb0101fd0 0x7f3bb01023d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009900 tx=0x7f3ba402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:07.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.017+0000 7f3bb8800640 1 -- 172.21.15.7:0/3657610277 shutdown_connections 2024-09-13T18:15:07.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.017+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3657610277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 0x7f3bb010a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:07.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.017+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3657610277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb01031c0 0x7f3bb0103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:07.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.017+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3657610277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb0101fd0 0x7f3bb01023d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:07.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.017+0000 7f3bb8800640 1 -- 172.21.15.7:0/3657610277 >> 172.21.15.7:0/3657610277 conn(0x7f3bb00fd730 msgr2=0x7f3bb00ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:07.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.018+0000 7f3bb8800640 1 -- 172.21.15.7:0/3657610277 shutdown_connections 2024-09-13T18:15:07.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.018+0000 7f3bb8800640 1 -- 172.21.15.7:0/3657610277 wait complete. 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.018+0000 7f3bb8800640 1 Processor -- start 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb8800640 1 -- start start 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb8800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb0101fd0 0x7f3bb0198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb8800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb01031c0 0x7f3bb0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb8800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 0x7f3bb019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb8800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb019faf0 con 0x7f3bb0103b80 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb8800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb019fc60 con 0x7f3bb0101fd0 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb8800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb019fe20 con 0x7f3bb01031c0 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 0x7f3bb019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 0x7f3bb019f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60406/0 (socket says 172.21.15.7:60406) 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb0101fd0 0x7f3bb0198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb5400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb01031c0 0x7f3bb0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb6800640 1 -- 172.21.15.7:0/3852646751 learned_addr learned my addr 172.21.15.7:0/3852646751 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb6800640 1 -- 172.21.15.7:0/3852646751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb01031c0 msgr2=0x7f3bb0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb6800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb01031c0 0x7f3bb0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb6800640 1 -- 172.21.15.7:0/3852646751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb0101fd0 msgr2=0x7f3bb0198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.019+0000 7f3bb6800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb0101fd0 0x7f3bb0198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3bb6800640 1 -- 172.21.15.7:0/3852646751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009840 con 0x7f3bb0103b80 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3bb5e00640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb0101fd0 0x7f3bb0198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3bb6800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 0x7f3bb019f5b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00efd0 tx=0x7f3bac00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3baaa00640 1 -- 172.21.15.7:0/3852646751 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac009b40 con 0x7f3bb0103b80 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3baaa00640 1 -- 172.21.15.7:0/3852646751 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bac003b70 con 0x7f3bb0103b80 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba4009560 con 0x7f3bb0103b80 2024-09-13T18:15:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3baaa00640 1 -- 172.21.15.7:0/3852646751 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac010850 con 0x7f3bb0103b80 2024-09-13T18:15:07.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.020+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb01a0430 con 0x7f3bb0103b80 2024-09-13T18:15:07.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.021+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0109500 con 0x7f3bb0103b80 2024-09-13T18:15:07.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.023+0000 7f3baaa00640 1 -- 172.21.15.7:0/3852646751 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f3bac004020 con 0x7f3bb0103b80 2024-09-13T18:15:07.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.024+0000 7f3baaa00640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b980a1090 0x7f3b980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:07.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.024+0000 7f3baaa00640 1 -- 172.21.15.7:0/3852646751 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3bac014070 con 0x7f3bb0103b80 2024-09-13T18:15:07.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.025+0000 7f3bb5e00640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b980a1090 0x7f3b980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:07.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.025+0000 7f3bb5e00640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b980a1090 0x7f3b980a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4031500 tx=0x7f3ba4005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.028+0000 7f3baaa00640 1 -- 172.21.15.7:0/3852646751 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3bac096660 con 0x7f3bb0103b80 2024-09-13T18:15:07.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:07.246+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3bb010d8c0 con 0x7f3bb0103b80 2024-09-13T18:15:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:07 smithi007 ceph-mon[30588]: pgmap v284: 97 pgs: 2 creating+activating, 11 creating+peering, 64 unknown, 20 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1917998303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:07 smithi007 ceph-mon[30588]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T18:15:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:07 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] up:active 2024-09-13T18:15:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:07 smithi007 ceph-mon[30588]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:07 smithi007 ceph-mon[30588]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3852646751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T18:15:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:07 smithi116 ceph-mon[35109]: pgmap v284: 97 pgs: 2 creating+activating, 11 creating+peering, 64 unknown, 20 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1917998303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:07 smithi116 ceph-mon[35109]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T18:15:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:07 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] up:active 2024-09-13T18:15:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:07 smithi116 ceph-mon[35109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:07 smithi116 ceph-mon[35109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3852646751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T18:15:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:07 smithi067 ceph-mon[35103]: pgmap v284: 97 pgs: 2 creating+activating, 11 creating+peering, 64 unknown, 20 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:15:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1917998303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:07 smithi067 ceph-mon[35103]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T18:15:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:07 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] up:active 2024-09-13T18:15:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:07 smithi067 ceph-mon[35103]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:07 smithi067 ceph-mon[35103]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:07.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3852646751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T18:15:08.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.018+0000 7f3baaa00640 1 -- 172.21.15.7:0/3852646751 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3bac099c80 con 0x7f3bb0103b80 2024-09-13T18:15:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b980a1090 msgr2=0x7f3b980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b980a1090 0x7f3b980a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4031500 tx=0x7f3ba4005780 comp rx=0 tx=0).stop 2024-09-13T18:15:08.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 msgr2=0x7f3bb019f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 0x7f3bb019f5b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00efd0 tx=0x7f3bac00c6a0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 shutdown_connections 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3b980a1090 0x7f3b980a3550 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bb0103b80 0x7f3bb019f5b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bb01031c0 0x7f3bb0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 --2- 172.21.15.7:0/3852646751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bb0101fd0 0x7f3bb0198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 >> 172.21.15.7:0/3852646751 conn(0x7f3bb00fd730 msgr2=0x7f3bb01066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 shutdown_connections 2024-09-13T18:15:08.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.021+0000 7f3bb8800640 1 -- 172.21.15.7:0/3852646751 wait complete. 2024-09-13T18:15:08.041 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-13T18:15:08.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 -- 172.21.15.7:0/489425851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10880760b0 msgr2=0x7f1088076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 --2- 172.21.15.7:0/489425851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10880760b0 0x7f1088076510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1074009900 tx=0x7f107402a410 comp rx=0 tx=0).stop 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 -- 172.21.15.7:0/489425851 shutdown_connections 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 --2- 172.21.15.7:0/489425851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1088076a50 0x7f10880772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 --2- 172.21.15.7:0/489425851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10880760b0 0x7f1088076510 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 --2- 172.21.15.7:0/489425851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1088074e70 0x7f1088075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 -- 172.21.15.7:0/489425851 >> 172.21.15.7:0/489425851 conn(0x7f10880fd720 msgr2=0x7f10880ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 -- 172.21.15.7:0/489425851 shutdown_connections 2024-09-13T18:15:08.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.201+0000 7f108ee00640 1 -- 172.21.15.7:0/489425851 wait complete. 2024-09-13T18:15:08.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.202+0000 7f108ee00640 1 Processor -- start 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.202+0000 7f108ee00640 1 -- start start 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f108ee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1088074e70 0x7f108819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f108ee00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10880760b0 0x7f108819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f108ee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1088076a50 0x7f10881a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f108ee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10881a3e60 con 0x7f1088074e70 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f108ee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10881a3fd0 con 0x7f1088076a50 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f108ee00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10881a4190 con 0x7f10880760b0 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1088074e70 0x7f108819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1088074e70 0x7f108819c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60418/0 (socket says 172.21.15.7:60418) 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 -- 172.21.15.7:0/2174464940 learned_addr learned my addr 172.21.15.7:0/2174464940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087400640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10880760b0 0x7f108819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:08.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f108ce00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1088076a50 0x7f10881a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 -- 172.21.15.7:0/2174464940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10880760b0 msgr2=0x7f108819c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10880760b0 0x7f108819c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 -- 172.21.15.7:0/2174464940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1088076a50 msgr2=0x7f10881a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1088076a50 0x7f10881a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.203+0000 7f1087e00640 1 -- 172.21.15.7:0/2174464940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074009560 con 0x7f1088074e70 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.204+0000 7f1087e00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1088074e70 0x7f108819c370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f107800e9f0 tx=0x7f107800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.204+0000 7f1084c00640 1 -- 172.21.15.7:0/2174464940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078009700 con 0x7f1088074e70 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.204+0000 7f1084c00640 1 -- 172.21.15.7:0/2174464940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f107800cd80 con 0x7f1088074e70 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.204+0000 7f1084c00640 1 -- 172.21.15.7:0/2174464940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078018860 con 0x7f1088074e70 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.204+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10881a4470 con 0x7f1088074e70 2024-09-13T18:15:08.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.204+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10881a4950 con 0x7f1088074e70 2024-09-13T18:15:08.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.205+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108810eb00 con 0x7f1088074e70 2024-09-13T18:15:08.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.207+0000 7f1084c00640 1 -- 172.21.15.7:0/2174464940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f10780189c0 con 0x7f1088074e70 2024-09-13T18:15:08.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.208+0000 7f1084c00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f106c0a1110 0x7f106c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:08.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.208+0000 7f1084c00640 1 -- 172.21.15.7:0/2174464940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1078014070 con 0x7f1088074e70 2024-09-13T18:15:08.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.208+0000 7f1087400640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f106c0a1110 0x7f106c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:08.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.209+0000 7f1087400640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f106c0a1110 0x7f106c0a35d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f107402aa00 tx=0x7f10740314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:08.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.212+0000 7f1084c00640 1 -- 172.21.15.7:0/2174464940 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1078052e20 con 0x7f1088074e70 2024-09-13T18:15:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:08.429+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f1088111c90 con 0x7f1088074e70 2024-09-13T18:15:09.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.023+0000 7f1084c00640 1 -- 172.21.15.7:0/2174464940 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f10780963e0 con 0x7f1088074e70 2024-09-13T18:15:09.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f106c0a1110 msgr2=0x7f106c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:09.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f106c0a1110 0x7f106c0a35d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f107402aa00 tx=0x7f10740314a0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1088074e70 msgr2=0x7f108819c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1088074e70 0x7f108819c370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f107800e9f0 tx=0x7f107800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 shutdown_connections 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f106c0a1110 0x7f106c0a35d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1088076a50 0x7f10881a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10880760b0 0x7f108819c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 --2- 172.21.15.7:0/2174464940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1088074e70 0x7f108819c370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 >> 172.21.15.7:0/2174464940 conn(0x7f10880fd720 msgr2=0x7f10880fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 shutdown_connections 2024-09-13T18:15:09.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.026+0000 7f108ee00640 1 -- 172.21.15.7:0/2174464940 wait complete. 2024-09-13T18:15:09.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 -- 172.21.15.7:0/2963270701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4103970 msgr2=0x7ff7b410a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 --2- 172.21.15.7:0/2963270701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4103970 0x7ff7b410a200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009ca0 tx=0x7ff7ac02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 -- 172.21.15.7:0/2963270701 shutdown_connections 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 --2- 172.21.15.7:0/2963270701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4103970 0x7ff7b410a200 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 --2- 172.21.15.7:0/2963270701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b4102fb0 0x7ff7b4103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 --2- 172.21.15.7:0/2963270701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7b4101dc0 0x7ff7b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 -- 172.21.15.7:0/2963270701 >> 172.21.15.7:0/2963270701 conn(0x7ff7b40fd540 msgr2=0x7ff7b40ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 -- 172.21.15.7:0/2963270701 shutdown_connections 2024-09-13T18:15:09.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.210+0000 7ff7b9800640 1 -- 172.21.15.7:0/2963270701 wait complete. 2024-09-13T18:15:09.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 Processor -- start 2024-09-13T18:15:09.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 -- start start 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b4101dc0 0x7ff7b4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4102fb0 0x7ff7b41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7b4103970 0x7ff7b419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b419f850 con 0x7ff7b4102fb0 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b419f9c0 con 0x7ff7b4101dc0 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b9800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b419fb80 con 0x7ff7b4103970 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7ab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4102fb0 0x7ff7b41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:09.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7ab400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4102fb0 0x7ff7b41982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60440/0 (socket says 172.21.15.7:60440) 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7ab400640 1 -- 172.21.15.7:0/3473449134 learned_addr learned my addr 172.21.15.7:0/3473449134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b3e00640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b4101dc0 0x7ff7b4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.211+0000 7ff7b8e00640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7b4103970 0x7ff7b419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7ab400640 1 -- 172.21.15.7:0/3473449134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7b4103970 msgr2=0x7ff7b419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7ab400640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7b4103970 0x7ff7b419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7ab400640 1 -- 172.21.15.7:0/3473449134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b4101dc0 msgr2=0x7ff7b4197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7ab400640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b4101dc0 0x7ff7b4197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7ab400640 1 -- 172.21.15.7:0/3473449134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009900 con 0x7ff7b4102fb0 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7ab400640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4102fb0 0x7ff7b41982a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00e9f0 tx=0x7ff79c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:09.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7b1600640 1 -- 172.21.15.7:0/3473449134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c009700 con 0x7ff7b4102fb0 2024-09-13T18:15:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7b1600640 1 -- 172.21.15.7:0/3473449134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff79c00cd80 con 0x7ff7b4102fb0 2024-09-13T18:15:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7b1600640 1 -- 172.21.15.7:0/3473449134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c018860 con 0x7ff7b4102fb0 2024-09-13T18:15:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b419fe60 con 0x7ff7b4102fb0 2024-09-13T18:15:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.212+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b41a0290 con 0x7ff7b4102fb0 2024-09-13T18:15:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.213+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b41091f0 con 0x7ff7b4102fb0 2024-09-13T18:15:09.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.215+0000 7ff7b1600640 1 -- 172.21.15.7:0/3473449134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7ff79c0189c0 con 0x7ff7b4102fb0 2024-09-13T18:15:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.216+0000 7ff7b1600640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7980a1090 0x7ff7980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.217+0000 7ff7b1600640 1 -- 172.21.15.7:0/3473449134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff79c014070 con 0x7ff7b4102fb0 2024-09-13T18:15:09.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.217+0000 7ff7b3e00640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7980a1090 0x7ff7980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:09.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.217+0000 7ff7b3e00640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7980a1090 0x7ff7980a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4102e10 tx=0x7ff7a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:09.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.221+0000 7ff7b1600640 1 -- 172.21.15.7:0/3473449134 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff79c052e20 con 0x7ff7b4102fb0 2024-09-13T18:15:09.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:09 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3852646751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T18:15:09.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:09 smithi007 ceph-mon[30588]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:09.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:09 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2174464940' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:15:09.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:09 smithi007 ceph-mon[30588]: pgmap v286: 97 pgs: 2 creating+activating, 11 creating+peering, 32 unknown, 52 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-13T18:15:09.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:09.434+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ff7b402c480 con 0x7ff7b4102fb0 2024-09-13T18:15:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:09 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3852646751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T18:15:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:09 smithi116 ceph-mon[35109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:09 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2174464940' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:15:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:09 smithi116 ceph-mon[35109]: pgmap v286: 97 pgs: 2 creating+activating, 11 creating+peering, 32 unknown, 52 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-13T18:15:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:09 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3852646751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T18:15:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:09 smithi067 ceph-mon[35103]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:09 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2174464940' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:15:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:09 smithi067 ceph-mon[35103]: pgmap v286: 97 pgs: 2 creating+activating, 11 creating+peering, 32 unknown, 52 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-13T18:15:10.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.029+0000 7ff7b1600640 1 -- 172.21.15.7:0/3473449134 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff79c0963d0 con 0x7ff7b4102fb0 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7980a1090 msgr2=0x7ff7980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7980a1090 0x7ff7980a3550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4102e10 tx=0x7ff7a4005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4102fb0 msgr2=0x7ff7b41982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4102fb0 0x7ff7b41982a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00e9f0 tx=0x7ff79c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 shutdown_connections 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7980a1090 0x7ff7980a3550 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7b4103970 0x7ff7b419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7b4102fb0 0x7ff7b41982a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 --2- 172.21.15.7:0/3473449134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7b4101dc0 0x7ff7b4197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 >> 172.21.15.7:0/3473449134 conn(0x7ff7b40fd540 msgr2=0x7ff7b41063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 shutdown_connections 2024-09-13T18:15:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.031+0000 7ff7b9800640 1 -- 172.21.15.7:0/3473449134 wait complete. 2024-09-13T18:15:10.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T18:15:10.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.215+0000 7f6c2fe00640 1 -- 172.21.15.7:0/2124785748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c300760b0 msgr2=0x7f6c30076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:10.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.215+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/2124785748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c300760b0 0x7f6c30076510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009860 tx=0x7f6c1802a340 comp rx=0 tx=0).stop 2024-09-13T18:15:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.216+0000 7f6c2fe00640 1 -- 172.21.15.7:0/2124785748 shutdown_connections 2024-09-13T18:15:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.216+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/2124785748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c30076a50 0x7f6c300772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.216+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/2124785748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c300760b0 0x7f6c30076510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.216+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/2124785748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c30074e70 0x7f6c30075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.216+0000 7f6c2fe00640 1 -- 172.21.15.7:0/2124785748 >> 172.21.15.7:0/2124785748 conn(0x7f6c300fd530 msgr2=0x7f6c300ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.216+0000 7f6c2fe00640 1 -- 172.21.15.7:0/2124785748 shutdown_connections 2024-09-13T18:15:10.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.216+0000 7f6c2fe00640 1 -- 172.21.15.7:0/2124785748 wait complete. 2024-09-13T18:15:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 Processor -- start 2024-09-13T18:15:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 -- start start 2024-09-13T18:15:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c30074e70 0x7f6c3019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300760b0 0x7f6c3019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30076a50 0x7f6c301a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:10.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301a3d20 con 0x7f6c300760b0 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301a3e90 con 0x7f6c30076a50 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301a4050 con 0x7f6c30074e70 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c26000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300760b0 0x7f6c3019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30076a50 0x7f6c301a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c26000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300760b0 0x7f6c3019c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60460/0 (socket says 172.21.15.7:60460) 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c26000640 1 -- 172.21.15.7:0/336943312 learned_addr learned my addr 172.21.15.7:0/336943312 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.217+0000 7f6c2ea00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c30074e70 0x7f6c3019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c26000640 1 -- 172.21.15.7:0/336943312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c30074e70 msgr2=0x7f6c3019c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c26000640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c30074e70 0x7f6c3019c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c26000640 1 -- 172.21.15.7:0/336943312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30076a50 msgr2=0x7f6c301a37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c26000640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30076a50 0x7f6c301a37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c26000640 1 -- 172.21.15.7:0/336943312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20009560 con 0x7f6c300760b0 2024-09-13T18:15:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c26000640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300760b0 0x7f6c3019c770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c180305e0 tx=0x7f6c18032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c27e00640 1 -- 172.21.15.7:0/336943312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18004040 con 0x7f6c300760b0 2024-09-13T18:15:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c18009490 con 0x7f6c300760b0 2024-09-13T18:15:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c27e00640 1 -- 172.21.15.7:0/336943312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c180035f0 con 0x7f6c300760b0 2024-09-13T18:15:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c27e00640 1 -- 172.21.15.7:0/336943312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1803e690 con 0x7f6c300760b0 2024-09-13T18:15:10.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.218+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c301a45f0 con 0x7f6c300760b0 2024-09-13T18:15:10.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.220+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3010e720 con 0x7f6c300760b0 2024-09-13T18:15:10.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.221+0000 7f6c27e00640 1 -- 172.21.15.7:0/336943312 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f6c180039b0 con 0x7f6c300760b0 2024-09-13T18:15:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.223+0000 7f6c27e00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6c140a1090 0x7f6c140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.223+0000 7f6c27e00640 1 -- 172.21.15.7:0/336943312 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6c180ed070 con 0x7f6c300760b0 2024-09-13T18:15:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.223+0000 7f6c2ea00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6c140a1090 0x7f6c140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:10.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.223+0000 7f6c2ea00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6c140a1090 0x7f6c140a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009530 tx=0x7f6c20009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:10.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.226+0000 7f6c27e00640 1 -- 172.21.15.7:0/336943312 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6c18120e20 con 0x7f6c300760b0 2024-09-13T18:15:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:10 smithi007 ceph-mon[30588]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:15:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:10 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2174464940' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-13T18:15:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:10 smithi007 ceph-mon[30588]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:15:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:10 smithi007 ceph-mon[30588]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:10 smithi007 ceph-mon[30588]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-13T18:15:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:10 smithi007 ceph-mon[30588]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-13T18:15:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:10 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3473449134' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:15:10.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:10.449+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f6c30111aa0 con 0x7f6c300760b0 2024-09-13T18:15:10.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:10 smithi116 ceph-mon[35109]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:15:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:10 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2174464940' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-13T18:15:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:10 smithi116 ceph-mon[35109]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:15:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:10 smithi116 ceph-mon[35109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:10 smithi116 ceph-mon[35109]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-13T18:15:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:10 smithi116 ceph-mon[35109]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-13T18:15:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:10 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3473449134' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:15:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:10 smithi067 ceph-mon[35103]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:15:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:10 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2174464940' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-13T18:15:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:10 smithi067 ceph-mon[35103]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:15:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:10 smithi067 ceph-mon[35103]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:15:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:10 smithi067 ceph-mon[35103]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-13T18:15:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:10 smithi067 ceph-mon[35103]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-13T18:15:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:10 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3473449134' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:15:11.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.043+0000 7f6c27e00640 1 -- 172.21.15.7:0/336943312 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6c180b68b0 con 0x7f6c300760b0 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6c140a1090 msgr2=0x7f6c140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6c140a1090 0x7f6c140a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009530 tx=0x7f6c20009260 comp rx=0 tx=0).stop 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300760b0 msgr2=0x7f6c3019c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300760b0 0x7f6c3019c770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c180305e0 tx=0x7f6c18032d20 comp rx=0 tx=0).stop 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 shutdown_connections 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6c140a1090 0x7f6c140a3550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30076a50 0x7f6c301a37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c300760b0 0x7f6c3019c770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 --2- 172.21.15.7:0/336943312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c30074e70 0x7f6c3019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.045+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 >> 172.21.15.7:0/336943312 conn(0x7f6c300fd530 msgr2=0x7f6c300ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:11.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.046+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 shutdown_connections 2024-09-13T18:15:11.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.046+0000 7f6c2fe00640 1 -- 172.21.15.7:0/336943312 wait complete. 2024-09-13T18:15:11.068 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-13T18:15:11.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 -- 172.21.15.7:0/1377595303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 msgr2=0x7fc328100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 --2- 172.21.15.7:0/1377595303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328100190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc318009900 tx=0x7fc31802a410 comp rx=0 tx=0).stop 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 -- 172.21.15.7:0/1377595303 shutdown_connections 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 --2- 172.21.15.7:0/1377595303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc328101940 0x7fc3281081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 --2- 172.21.15.7:0/1377595303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328100f80 0x7fc328101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 --2- 172.21.15.7:0/1377595303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328100190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 -- 172.21.15.7:0/1377595303 >> 172.21.15.7:0/1377595303 conn(0x7fc3280fb510 msgr2=0x7fc3280fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:11.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 -- 172.21.15.7:0/1377595303 shutdown_connections 2024-09-13T18:15:11.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.227+0000 7fc32d800640 1 -- 172.21.15.7:0/1377595303 wait complete. 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.228+0000 7fc32d800640 1 Processor -- start 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.228+0000 7fc32d800640 1 -- start start 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc32d800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc32d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328100f80 0x7fc3280728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc32d800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc328101940 0x7fc328072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc32d800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328073540 con 0x7fc3280ffd90 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc32d800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280736b0 con 0x7fc328100f80 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc32d800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32819fe10 con 0x7fc328101940 2024-09-13T18:15:11.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60484/0 (socket says 172.21.15.7:60484) 2024-09-13T18:15:11.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 -- 172.21.15.7:0/2623422295 learned_addr learned my addr 172.21.15.7:0/2623422295 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:11.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326000640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328100f80 0x7fc3280728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc327400640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc328101940 0x7fc328072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 -- 172.21.15.7:0/2623422295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc328101940 msgr2=0x7fc328072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc328101940 0x7fc328072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 -- 172.21.15.7:0/2623422295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328100f80 msgr2=0x7fc3280728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328100f80 0x7fc3280728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.229+0000 7fc326a00640 1 -- 172.21.15.7:0/2623422295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009560 con 0x7fc3280ffd90 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.230+0000 7fc326a00640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328074260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc31802a930 tx=0x7fc318003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.230+0000 7fc31f400640 1 -- 172.21.15.7:0/2623422295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180315a0 con 0x7fc3280ffd90 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.230+0000 7fc31f400640 1 -- 172.21.15.7:0/2623422295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc318031bc0 con 0x7fc3280ffd90 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.230+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3281a0060 con 0x7fc3280ffd90 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.230+0000 7fc31f400640 1 -- 172.21.15.7:0/2623422295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31803bce0 con 0x7fc3280ffd90 2024-09-13T18:15:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.230+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3281a0510 con 0x7fc3280ffd90 2024-09-13T18:15:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.231+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3281071c0 con 0x7fc3280ffd90 2024-09-13T18:15:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.233+0000 7fc31f400640 1 -- 172.21.15.7:0/2623422295 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fc31803b460 con 0x7fc3280ffd90 2024-09-13T18:15:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.234+0000 7fc31f400640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc30c0a1090 0x7fc30c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.234+0000 7fc31f400640 1 -- 172.21.15.7:0/2623422295 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc3180ed0c0 con 0x7fc3280ffd90 2024-09-13T18:15:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.234+0000 7fc326000640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc30c0a1090 0x7fc30c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.235+0000 7fc326000640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc30c0a1090 0x7fc30c0a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc328073fd0 tx=0x7fc314005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:11.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.238+0000 7fc31f400640 1 -- 172.21.15.7:0/2623422295 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc3180b69b0 con 0x7fc3280ffd90 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] up:active 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3473449134' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/336943312' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T18:15:11.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-mon[30588]: pgmap v287: 97 pgs: 2 creating+activating, 11 creating+peering, 4 unknown, 80 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 5 op/s 2024-09-13T18:15:11.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.442+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fc32802c450 con 0x7fc30c0a1090 2024-09-13T18:15:11.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] up:active 2024-09-13T18:15:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3473449134' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:15:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T18:15:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-13T18:15:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-13T18:15:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-13T18:15:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/336943312' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T18:15:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:11 smithi116 ceph-mon[35109]: pgmap v287: 97 pgs: 2 creating+activating, 11 creating+peering, 4 unknown, 80 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 5 op/s 2024-09-13T18:15:11.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.472+0000 7fc31f400640 1 -- 172.21.15.7:0/2623422295 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc32802c450 con 0x7fc30c0a1090 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc30c0a1090 msgr2=0x7fc30c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc30c0a1090 0x7fc30c0a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc328073fd0 tx=0x7fc314005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 msgr2=0x7fc328074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328074260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc31802a930 tx=0x7fc318003c10 comp rx=0 tx=0).stop 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 shutdown_connections 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc30c0a1090 0x7fc30c0a3550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc328101940 0x7fc328072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328100f80 0x7fc3280728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 --2- 172.21.15.7:0/2623422295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3280ffd90 0x7fc328074260 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 >> 172.21.15.7:0/2623422295 conn(0x7fc3280fb510 msgr2=0x7fc328104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 shutdown_connections 2024-09-13T18:15:11.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.474+0000 7fc32d800640 1 -- 172.21.15.7:0/2623422295 wait complete. 2024-09-13T18:15:11.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-13T18:15:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] up:active 2024-09-13T18:15:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3473449134' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:15:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T18:15:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-13T18:15:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-13T18:15:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-13T18:15:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/336943312' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T18:15:11.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-mon[35103]: pgmap v287: 97 pgs: 2 creating+activating, 11 creating+peering, 4 unknown, 80 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 5 op/s 2024-09-13T18:15:11.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.653+0000 7fca5ea00640 1 -- 172.21.15.7:0/162276154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58102fa0 msgr2=0x7fca58103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.653+0000 7fca5ea00640 1 --2- 172.21.15.7:0/162276154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58102fa0 0x7fca58103420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca44009860 tx=0x7fca4402a340 comp rx=0 tx=0).stop 2024-09-13T18:15:11.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 -- 172.21.15.7:0/162276154 shutdown_connections 2024-09-13T18:15:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 --2- 172.21.15.7:0/162276154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca58103960 0x7fca5810a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 --2- 172.21.15.7:0/162276154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58102fa0 0x7fca58103420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 --2- 172.21.15.7:0/162276154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58101db0 0x7fca581021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 -- 172.21.15.7:0/162276154 >> 172.21.15.7:0/162276154 conn(0x7fca580fd530 msgr2=0x7fca580ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 -- 172.21.15.7:0/162276154 shutdown_connections 2024-09-13T18:15:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 -- 172.21.15.7:0/162276154 wait complete. 2024-09-13T18:15:11.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.654+0000 7fca5ea00640 1 Processor -- start 2024-09-13T18:15:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5ea00640 1 -- start start 2024-09-13T18:15:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5ea00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58101db0 0x7fca58197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca58102fa0 0x7fca58198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58103960 0x7fca5819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5819f900 con 0x7fca58103960 2024-09-13T18:15:11.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5ea00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5819fa70 con 0x7fca58102fa0 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5ea00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5819fc30 con 0x7fca58101db0 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58103960 0x7fca5819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5d600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58101db0 0x7fca58197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58103960 0x7fca5819f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60510/0 (socket says 172.21.15.7:60510) 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5e000640 1 -- 172.21.15.7:0/3972231041 learned_addr learned my addr 172.21.15.7:0/3972231041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.655+0000 7fca5cc00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca58102fa0 0x7fca58198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5d600640 1 -- 172.21.15.7:0/3972231041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca58102fa0 msgr2=0x7fca58198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5d600640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca58102fa0 0x7fca58198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5d600640 1 -- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58103960 msgr2=0x7fca5819f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5d600640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58103960 0x7fca5819f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5d600640 1 -- 172.21.15.7:0/3972231041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c009560 con 0x7fca58101db0 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5e000640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58103960 0x7fca5819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5d600640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58101db0 0x7fca58197e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca58102e00 tx=0x7fca4c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca56000640 1 -- 172.21.15.7:0/3972231041 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c004440 con 0x7fca58101db0 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca50009840 con 0x7fca58101db0 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca56000640 1 -- 172.21.15.7:0/3972231041 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca4c00cd80 con 0x7fca58101db0 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca56000640 1 -- 172.21.15.7:0/3972231041 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c019480 con 0x7fca58101db0 2024-09-13T18:15:11.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.656+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca44009490 con 0x7fca58101db0 2024-09-13T18:15:11.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.657+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca58109300 con 0x7fca58101db0 2024-09-13T18:15:11.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.659+0000 7fca56000640 1 -- 172.21.15.7:0/3972231041 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fca4c00c8c0 con 0x7fca58101db0 2024-09-13T18:15:11.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.660+0000 7fca56000640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fca400a1090 0x7fca400a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:11.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.661+0000 7fca56000640 1 -- 172.21.15.7:0/3972231041 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fca4c014070 con 0x7fca58101db0 2024-09-13T18:15:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.661+0000 7fca5cc00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fca400a1090 0x7fca400a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.661+0000 7fca5cc00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fca400a1090 0x7fca400a3550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca44030410 tx=0x7fca44030580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:11.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.663+0000 7fca56000640 1 -- 172.21.15.7:0/3972231041 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca4c096730 con 0x7fca58101db0 2024-09-13T18:15:11.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:15:11.448+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:15:11.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:15:11.448+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:15:11.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:15:11.448+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:15:11.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:15:11.448+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:15:11.791 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:15:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:15:11.448+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:15:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.870+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fca5802c4f0 con 0x7fca400a1090 2024-09-13T18:15:11.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.897+0000 7fca56000640 1 -- 172.21.15.7:0/3972231041 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fca5802c4f0 con 0x7fca400a1090 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fca400a1090 msgr2=0x7fca400a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fca400a1090 0x7fca400a3550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca44030410 tx=0x7fca44030580 comp rx=0 tx=0).stop 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58101db0 msgr2=0x7fca58197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58101db0 0x7fca58197e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca58102e00 tx=0x7fca4c00ee50 comp rx=0 tx=0).stop 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 shutdown_connections 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fca400a1090 0x7fca400a3550 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca58103960 0x7fca5819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca58102fa0 0x7fca58198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 --2- 172.21.15.7:0/3972231041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58101db0 0x7fca58197e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:11.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.899+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 >> 172.21.15.7:0/3972231041 conn(0x7fca580fd530 msgr2=0x7fca581064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:11.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.900+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 shutdown_connections 2024-09-13T18:15:11.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:11.900+0000 7fca5ea00640 1 -- 172.21.15.7:0/3972231041 wait complete. 2024-09-13T18:15:11.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 -- 172.21.15.7:0/1762442901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb140100f80 msgr2=0x7fb140101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 --2- 172.21.15.7:0/1762442901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb140100f80 0x7fb140101400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009900 tx=0x7fb12c02a410 comp rx=0 tx=0).stop 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 -- 172.21.15.7:0/1762442901 shutdown_connections 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 --2- 172.21.15.7:0/1762442901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb140101940 0x7fb1401081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 --2- 172.21.15.7:0/1762442901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb140100f80 0x7fb140101400 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 --2- 172.21.15.7:0/1762442901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1400ffd90 0x7fb140100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 -- 172.21.15.7:0/1762442901 >> 172.21.15.7:0/1762442901 conn(0x7fb1400fb510 msgr2=0x7fb1400fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:12.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 -- 172.21.15.7:0/1762442901 shutdown_connections 2024-09-13T18:15:12.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.082+0000 7fb146c00640 1 -- 172.21.15.7:0/1762442901 wait complete. 2024-09-13T18:15:12.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.083+0000 7fb146c00640 1 Processor -- start 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.083+0000 7fb146c00640 1 -- start start 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.083+0000 7fb146c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1400ffd90 0x7fb140197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.083+0000 7fb146c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb140100f80 0x7fb1401984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb146c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb140101940 0x7fb14019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb146c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14019fa60 con 0x7fb1400ffd90 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb146c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14019fbd0 con 0x7fb140100f80 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb146c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14019fd90 con 0x7fb140101940 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1400ffd90 0x7fb140197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1400ffd90 0x7fb140197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60528/0 (socket says 172.21.15.7:60528) 2024-09-13T18:15:12.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 -- 172.21.15.7:0/3851808454 learned_addr learned my addr 172.21.15.7:0/3851808454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb144c00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb140101940 0x7fb14019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13f400640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb140100f80 0x7fb1401984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 -- 172.21.15.7:0/3851808454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb140101940 msgr2=0x7fb14019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb140101940 0x7fb14019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 -- 172.21.15.7:0/3851808454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb140100f80 msgr2=0x7fb1401984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb140100f80 0x7fb1401984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 -- 172.21.15.7:0/3851808454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c009560 con 0x7fb1400ffd90 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13f400640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb140100f80 0x7fb1401984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.084+0000 7fb13fe00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1400ffd90 0x7fb140197f70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb13000d950 tx=0x7fb13000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.085+0000 7fb13cc00640 1 -- 172.21.15.7:0/3851808454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb130009c30 con 0x7fb1400ffd90 2024-09-13T18:15:12.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.085+0000 7fb13cc00640 1 -- 172.21.15.7:0/3851808454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb130009d90 con 0x7fb1400ffd90 2024-09-13T18:15:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.085+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1401a0070 con 0x7fb1400ffd90 2024-09-13T18:15:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.085+0000 7fb13cc00640 1 -- 172.21.15.7:0/3851808454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13000f7e0 con 0x7fb1400ffd90 2024-09-13T18:15:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.085+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1401a05a0 con 0x7fb1400ffd90 2024-09-13T18:15:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.086+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14010b6a0 con 0x7fb1400ffd90 2024-09-13T18:15:12.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.087+0000 7fb13cc00640 1 -- 172.21.15.7:0/3851808454 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fb130010460 con 0x7fb1400ffd90 2024-09-13T18:15:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.089+0000 7fb13cc00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb1240a1110 0x7fb1240a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.089+0000 7fb13cc00640 1 -- 172.21.15.7:0/3851808454 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb1300cc9d0 con 0x7fb1400ffd90 2024-09-13T18:15:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.089+0000 7fb13f400640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb1240a1110 0x7fb1240a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.090+0000 7fb13f400640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb1240a1110 0x7fb1240a35d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb12c000c00 tx=0x7fb12c005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:12.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.092+0000 7fb13cc00640 1 -- 172.21.15.7:0/3851808454 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb130096210 con 0x7fb1400ffd90 2024-09-13T18:15:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:12 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] up:active 2024-09-13T18:15:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:12 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/336943312' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T18:15:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:12 smithi067 ceph-mon[35103]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-13T18:15:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:12 smithi067 ceph-mon[35103]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-13T18:15:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:12 smithi067 ceph-mon[35103]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-13T18:15:12.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:12 smithi067 ceph-mon[35103]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-13T18:15:12.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:12 smithi067 ceph-mon[35103]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:12.248 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: 2024-09-13T18:15:11.984+0000 7f1eed9fa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:15:12.248 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: 2024-09-13T18:15:11.984+0000 7f1eed9fa640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T18:15:12.248 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:15:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: 2024-09-13T18:15:11.984+0000 7f1eed9fa640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:15:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:12 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] up:active 2024-09-13T18:15:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:12 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/336943312' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T18:15:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:12 smithi007 ceph-mon[30588]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-13T18:15:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:12 smithi007 ceph-mon[30588]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-13T18:15:12.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:12 smithi007 ceph-mon[30588]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-13T18:15:12.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:12 smithi007 ceph-mon[30588]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-13T18:15:12.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:12 smithi007 ceph-mon[30588]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:12.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.303+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb140107ec0 con 0x7fb1240a1110 2024-09-13T18:15:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.310+0000 7fb13cc00640 1 -- 172.21.15.7:0/3851808454 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fb140107ec0 con 0x7fb1240a1110 2024-09-13T18:15:12.312 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_0/9ff2a6f2-9478-4945-bc89-d635957651fe 2024-09-13T18:15:12.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb1240a1110 msgr2=0x7fb1240a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb1240a1110 0x7fb1240a35d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb12c000c00 tx=0x7fb12c005760 comp rx=0 tx=0).stop 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1400ffd90 msgr2=0x7fb140197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1400ffd90 0x7fb140197f70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb13000d950 tx=0x7fb13000de10 comp rx=0 tx=0).stop 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 shutdown_connections 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb1240a1110 0x7fb1240a35d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb140101940 0x7fb14019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb140100f80 0x7fb1401984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 --2- 172.21.15.7:0/3851808454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1400ffd90 0x7fb140197f70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 >> 172.21.15.7:0/3851808454 conn(0x7fb1400fb510 msgr2=0x7fb1401067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 shutdown_connections 2024-09-13T18:15:12.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.312+0000 7fb146c00640 1 -- 172.21.15.7:0/3851808454 wait complete. 2024-09-13T18:15:12.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-13T18:15:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:12 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] up:active 2024-09-13T18:15:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:12 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/336943312' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T18:15:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:12 smithi116 ceph-mon[35109]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-13T18:15:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:12 smithi116 ceph-mon[35109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-13T18:15:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:12 smithi116 ceph-mon[35109]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-13T18:15:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:12 smithi116 ceph-mon[35109]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-13T18:15:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:12 smithi116 ceph-mon[35109]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:12.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 -- 172.21.15.7:0/1220635623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c100f80 msgr2=0x7f959c101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 --2- 172.21.15.7:0/1220635623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c100f80 0x7f959c101400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9588009900 tx=0x7f958802a410 comp rx=0 tx=0).stop 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 -- 172.21.15.7:0/1220635623 shutdown_connections 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 --2- 172.21.15.7:0/1220635623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f959c101940 0x7f959c1081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 --2- 172.21.15.7:0/1220635623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c100f80 0x7f959c101400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 --2- 172.21.15.7:0/1220635623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f959c0ffd90 0x7f959c100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 -- 172.21.15.7:0/1220635623 >> 172.21.15.7:0/1220635623 conn(0x7f959c0fb510 msgr2=0x7f959c0fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 -- 172.21.15.7:0/1220635623 shutdown_connections 2024-09-13T18:15:12.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.492+0000 7f95a3c00640 1 -- 172.21.15.7:0/1220635623 wait complete. 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 Processor -- start 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 -- start start 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c0ffd90 0x7f959c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f959c100f80 0x7f959c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f959c101940 0x7f959c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c19fa60 con 0x7f959c0ffd90 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c19fbd0 con 0x7f959c101940 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.493+0000 7f95a3c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c19fd90 con 0x7f959c100f80 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c0ffd90 0x7f959c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f959be00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f959c100f80 0x7f959c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c0ffd90 0x7f959c197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60560/0 (socket says 172.21.15.7:60560) 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 -- 172.21.15.7:0/857280234 learned_addr learned my addr 172.21.15.7:0/857280234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f959c101940 0x7f959c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 -- 172.21.15.7:0/857280234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f959c100f80 msgr2=0x7f959c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f959c100f80 0x7f959c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 -- 172.21.15.7:0/857280234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f959c101940 msgr2=0x7f959c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f959c101940 0x7f959c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 -- 172.21.15.7:0/857280234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9588009560 con 0x7f959c0ffd90 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f959c101940 0x7f959c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a1200640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c0ffd90 0x7f959c197f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f959000e9c0 tx=0x7f959000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f9599600640 1 -- 172.21.15.7:0/857280234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590009700 con 0x7f959c0ffd90 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c1a0070 con 0x7f959c0ffd90 2024-09-13T18:15:12.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.494+0000 7f9599600640 1 -- 172.21.15.7:0/857280234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f95900044e0 con 0x7f959c0ffd90 2024-09-13T18:15:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.495+0000 7f9599600640 1 -- 172.21.15.7:0/857280234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590018430 con 0x7f959c0ffd90 2024-09-13T18:15:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.495+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c1a0550 con 0x7f959c0ffd90 2024-09-13T18:15:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.495+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c10b6a0 con 0x7f959c0ffd90 2024-09-13T18:15:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.497+0000 7f9599600640 1 -- 172.21.15.7:0/857280234 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f9590003f20 con 0x7f959c0ffd90 2024-09-13T18:15:12.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.499+0000 7f9599600640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f95840a1090 0x7f95840a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.499+0000 7f9599600640 1 -- 172.21.15.7:0/857280234 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9590014070 con 0x7f959c0ffd90 2024-09-13T18:15:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.499+0000 7f959be00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f95840a1090 0x7f95840a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.500+0000 7f959be00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f95840a1090 0x7f95840a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9588005ab0 tx=0x7f9588005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:12.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.501+0000 7f9599600640 1 -- 172.21.15.7:0/857280234 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9590096670 con 0x7f959c0ffd90 2024-09-13T18:15:12.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.706+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f959c107ec0 con 0x7f95840a1090 2024-09-13T18:15:12.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.733+0000 7f9599600640 1 -- 172.21.15.7:0/857280234 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f959c107ec0 con 0x7f95840a1090 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f95840a1090 msgr2=0x7f95840a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f95840a1090 0x7f95840a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9588005ab0 tx=0x7f9588005780 comp rx=0 tx=0).stop 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c0ffd90 msgr2=0x7f959c197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c0ffd90 0x7f959c197f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f959000e9c0 tx=0x7f959000ee80 comp rx=0 tx=0).stop 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 shutdown_connections 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f95840a1090 0x7f95840a3550 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f959c101940 0x7f959c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f959c100f80 0x7f959c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 --2- 172.21.15.7:0/857280234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f959c0ffd90 0x7f959c197f70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 >> 172.21.15.7:0/857280234 conn(0x7f959c0fb510 msgr2=0x7f959c1067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:12.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 shutdown_connections 2024-09-13T18:15:12.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.735+0000 7f95a3c00640 1 -- 172.21.15.7:0/857280234 wait complete. 2024-09-13T18:15:12.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.914+0000 7f6fa3e00640 1 -- 172.21.15.7:0/2697823609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4102fb0 msgr2=0x7f6fa4103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.914+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/2697823609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4102fb0 0x7f6fa4103430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009900 tx=0x7f6f9002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.915+0000 7f6fa3e00640 1 -- 172.21.15.7:0/2697823609 shutdown_connections 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.915+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/2697823609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa4103970 0x7f6fa410a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.915+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/2697823609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4102fb0 0x7f6fa4103430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.915+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/2697823609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fa4101dc0 0x7f6fa41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.915+0000 7f6fa3e00640 1 -- 172.21.15.7:0/2697823609 >> 172.21.15.7:0/2697823609 conn(0x7f6fa40fd540 msgr2=0x7f6fa40ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.915+0000 7f6fa3e00640 1 -- 172.21.15.7:0/2697823609 shutdown_connections 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.915+0000 7f6fa3e00640 1 -- 172.21.15.7:0/2697823609 wait complete. 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 Processor -- start 2024-09-13T18:15:12.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 -- start start 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4101dc0 0x7f6fa4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fa4102fb0 0x7f6fa4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa4103970 0x7f6fa419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa419f8f0 con 0x7f6fa4101dc0 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa419fa60 con 0x7f6fa4102fb0 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa419fc20 con 0x7f6fa4103970 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4101dc0 0x7f6fa4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4101dc0 0x7f6fa4197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60584/0 (socket says 172.21.15.7:60584) 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa2a00640 1 -- 172.21.15.7:0/4229968358 learned_addr learned my addr 172.21.15.7:0/4229968358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa3400640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa4103970 0x7f6fa419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.916+0000 7f6fa2000640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fa4102fb0 0x7f6fa4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa2a00640 1 -- 172.21.15.7:0/4229968358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa4103970 msgr2=0x7f6fa419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa2a00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa4103970 0x7f6fa419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa2a00640 1 -- 172.21.15.7:0/4229968358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fa4102fb0 msgr2=0x7f6fa4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa2a00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fa4102fb0 0x7f6fa4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa2a00640 1 -- 172.21.15.7:0/4229968358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f90009560 con 0x7f6fa4101dc0 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa2000640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fa4102fb0 0x7f6fa4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa2a00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4101dc0 0x7f6fa4197e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400e9c0 tx=0x7f6f9400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94009700 con 0x7f6fa4101dc0 2024-09-13T18:15:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f940044e0 con 0x7f6fa4101dc0 2024-09-13T18:15:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa419ff00 con 0x7f6fa4101dc0 2024-09-13T18:15:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94010430 con 0x7f6fa4101dc0 2024-09-13T18:15:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.917+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa41a0330 con 0x7f6fa4101dc0 2024-09-13T18:15:12.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.918+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa4109240 con 0x7f6fa4101dc0 2024-09-13T18:15:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.920+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f6f94003f40 con 0x7f6fa4101dc0 2024-09-13T18:15:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.921+0000 7f6fa8a00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6f880a1110 0x7f6f880a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.922+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6f94014070 con 0x7f6fa4101dc0 2024-09-13T18:15:12.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.922+0000 7f6fa2000640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6f880a1110 0x7f6f880a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:12.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.922+0000 7f6fa2000640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6f880a1110 0x7f6f880a35d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f90005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:12.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:12.924+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6f94096630 con 0x7f6fa4101dc0 2024-09-13T18:15:13.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.068+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f6f940041f0 con 0x7f6fa4101dc0 2024-09-13T18:15:13.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.141+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa402c4f0 con 0x7f6f880a1110 2024-09-13T18:15:13.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.146+0000 7f6fa8a00640 1 -- 172.21.15.7:0/4229968358 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f6fa402c4f0 con 0x7f6f880a1110 2024-09-13T18:15:13.149 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_1/8c32217c-01d8-47a4-a5da-f0fd99d5f9ac 2024-09-13T18:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.148+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6f880a1110 msgr2=0x7f6f880a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.148+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6f880a1110 0x7f6f880a35d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f90005760 comp rx=0 tx=0).stop 2024-09-13T18:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4101dc0 msgr2=0x7f6fa4197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4101dc0 0x7f6fa4197e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400e9c0 tx=0x7f6f9400ee80 comp rx=0 tx=0).stop 2024-09-13T18:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 shutdown_connections 2024-09-13T18:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6f880a1110 0x7f6f880a35d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa4103970 0x7f6fa419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fa4102fb0 0x7f6fa4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 --2- 172.21.15.7:0/4229968358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6fa4101dc0 0x7f6fa4197e00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 >> 172.21.15.7:0/4229968358 conn(0x7f6fa40fd540 msgr2=0x7f6fa4106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 shutdown_connections 2024-09-13T18:15:13.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.149+0000 7f6fa3e00640 1 -- 172.21.15.7:0/4229968358 wait complete. 2024-09-13T18:15:13.168 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 -- 172.21.15.7:0/3547533388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d80744f0 msgr2=0x7f04d8072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 --2- 172.21.15.7:0/3547533388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d80744f0 0x7f04d8072940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009860 tx=0x7f04c802a340 comp rx=0 tx=0).stop 2024-09-13T18:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 -- 172.21.15.7:0/3547533388 shutdown_connections 2024-09-13T18:15:13.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 --2- 172.21.15.7:0/3547533388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d810c3b0 0x7f04d810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 --2- 172.21.15.7:0/3547533388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04d8072f10 0x7f04d8073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 --2- 172.21.15.7:0/3547533388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d80744f0 0x7f04d8072940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 -- 172.21.15.7:0/3547533388 >> 172.21.15.7:0/3547533388 conn(0x7f04d80fb560 msgr2=0x7f04d80fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.322+0000 7f04dde00640 1 -- 172.21.15.7:0/3547533388 shutdown_connections 2024-09-13T18:15:13.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.323+0000 7f04dde00640 1 -- 172.21.15.7:0/3547533388 wait complete. 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.323+0000 7f04dde00640 1 Processor -- start 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04dde00640 1 -- start start 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04dde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8072f10 0x7f04d819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04dde00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04d80744f0 0x7f04d819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04dde00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d810c3b0 0x7f04d81a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04dde00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d81a3f10 con 0x7f04d8072f10 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04dde00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d81a4080 con 0x7f04d810c3b0 2024-09-13T18:15:13.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04dde00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d81a4240 con 0x7f04d80744f0 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04d6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8072f10 0x7f04d819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04d6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8072f10 0x7f04d819c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60598/0 (socket says 172.21.15.7:60598) 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04d6a00640 1 -- 172.21.15.7:0/270941950 learned_addr learned my addr 172.21.15.7:0/270941950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04d7400640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d810c3b0 0x7f04d81a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04cfe00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04d80744f0 0x7f04d819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04d6a00640 1 -- 172.21.15.7:0/270941950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04d80744f0 msgr2=0x7f04d819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.324+0000 7f04d6a00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04d80744f0 0x7f04d819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04d6a00640 1 -- 172.21.15.7:0/270941950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d810c3b0 msgr2=0x7f04d81a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04d6a00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d810c3b0 0x7f04d81a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04d6a00640 1 -- 172.21.15.7:0/270941950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009490 con 0x7f04d8072f10 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04d6a00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8072f10 0x7f04d819c420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f04c80305e0 tx=0x7f04c8032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:13.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04dca00640 1 -- 172.21.15.7:0/270941950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8004040 con 0x7f04d8072f10 2024-09-13T18:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04dca00640 1 -- 172.21.15.7:0/270941950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c80035f0 con 0x7f04d8072f10 2024-09-13T18:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04dca00640 1 -- 172.21.15.7:0/270941950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c803e690 con 0x7f04d8072f10 2024-09-13T18:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c8009490 con 0x7f04d8072f10 2024-09-13T18:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.325+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d81a4790 con 0x7f04d8072f10 2024-09-13T18:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.326+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d8111cd0 con 0x7f04d8072f10 2024-09-13T18:15:13.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.328+0000 7f04dca00640 1 -- 172.21.15.7:0/270941950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f04c80039b0 con 0x7f04d8072f10 2024-09-13T18:15:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.329+0000 7f04dca00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04bc0a1120 0x7f04bc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.329+0000 7f04dca00640 1 -- 172.21.15.7:0/270941950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f04c80ed4a0 con 0x7f04d8072f10 2024-09-13T18:15:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.330+0000 7f04cfe00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04bc0a1120 0x7f04bc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.330+0000 7f04cfe00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04bc0a1120 0x7f04bc0a35e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f04d819d930 tx=0x7f04c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:13.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.332+0000 7f04dca00640 1 -- 172.21.15.7:0/270941950 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f04c80b6c90 con 0x7f04d8072f10 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: from='client.24688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] up:active 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: Cluster is now healthy 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: pgmap v288: 97 pgs: 97 active+clean; 599 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s wr, 17 op/s 2024-09-13T18:15:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] up:active 2024-09-13T18:15:13.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:13 smithi116 ceph-mon[35109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:15:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: from='client.24688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] up:active 2024-09-13T18:15:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-13T18:15:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:15:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: Cluster is now healthy 2024-09-13T18:15:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-13T18:15:13.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-13T18:15:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-13T18:15:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: pgmap v288: 97 pgs: 97 active+clean; 599 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s wr, 17 op/s 2024-09-13T18:15:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] up:active 2024-09-13T18:15:13.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:13 smithi067 ceph-mon[35103]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:15:13.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: from='client.24688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:13.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] up:active 2024-09-13T18:15:13.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-13T18:15:13.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:15:13.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: Cluster is now healthy 2024-09-13T18:15:13.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-13T18:15:13.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-13T18:15:13.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-13T18:15:13.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:13.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: pgmap v288: 97 pgs: 97 active+clean; 599 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s wr, 17 op/s 2024-09-13T18:15:13.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] up:active 2024-09-13T18:15:13.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:13 smithi007 ceph-mon[30588]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:15:13.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.549+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04d8111eb0 con 0x7f04d8072f10 2024-09-13T18:15:13.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.550+0000 7f04dca00640 1 -- 172.21.15.7:0/270941950 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10889 (secure 0 0 0) 0x7f04c80ba2b0 con 0x7f04d8072f10 2024-09-13T18:15:13.552 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:13.552 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:15:12.707791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:15:13.553 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T18:15:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04bc0a1120 msgr2=0x7f04bc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04bc0a1120 0x7f04bc0a35e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f04d819d930 tx=0x7f04c0005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8072f10 msgr2=0x7f04d819c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8072f10 0x7f04d819c420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f04c80305e0 tx=0x7f04c8032d20 comp rx=0 tx=0).stop 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 shutdown_connections 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04bc0a1120 0x7f04bc0a35e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d810c3b0 0x7f04d81a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04d80744f0 0x7f04d819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 --2- 172.21.15.7:0/270941950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04d8072f10 0x7f04d819c420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 >> 172.21.15.7:0/270941950 conn(0x7f04d80fb560 msgr2=0x7f04d80fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 shutdown_connections 2024-09-13T18:15:13.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.552+0000 7f04dde00640 1 -- 172.21.15.7:0/270941950 wait complete. 2024-09-13T18:15:13.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:15:13.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 -- 172.21.15.7:0/2124352223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808101e00 msgr2=0x7f1808102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 --2- 172.21.15.7:0/2124352223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808101e00 0x7f1808102200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009900 tx=0x7f17f802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 -- 172.21.15.7:0/2124352223 shutdown_connections 2024-09-13T18:15:13.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 --2- 172.21.15.7:0/2124352223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18081039b0 0x7f180810a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 --2- 172.21.15.7:0/2124352223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1808102ff0 0x7f1808103470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 --2- 172.21.15.7:0/2124352223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808101e00 0x7f1808102200 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 -- 172.21.15.7:0/2124352223 >> 172.21.15.7:0/2124352223 conn(0x7f18080fd580 msgr2=0x7f18080ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 -- 172.21.15.7:0/2124352223 shutdown_connections 2024-09-13T18:15:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.727+0000 7f1807e00640 1 -- 172.21.15.7:0/2124352223 wait complete. 2024-09-13T18:15:13.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.728+0000 7f1807e00640 1 Processor -- start 2024-09-13T18:15:13.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.728+0000 7f1807e00640 1 -- start start 2024-09-13T18:15:13.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.728+0000 7f1807e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1808101e00 0x7f1808197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.728+0000 7f1807e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808102ff0 0x7f1808198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f1807e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18081039b0 0x7f180819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f1807e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180819f930 con 0x7f1808102ff0 2024-09-13T18:15:13.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f1807e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180819faa0 con 0x7f1808101e00 2024-09-13T18:15:13.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f1807e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180819fc60 con 0x7f18081039b0 2024-09-13T18:15:13.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808102ff0 0x7f1808198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808102ff0 0x7f1808198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60606/0 (socket says 172.21.15.7:60606) 2024-09-13T18:15:13.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f1806a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1808101e00 0x7f1808197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 -- 172.21.15.7:0/596293592 learned_addr learned my addr 172.21.15.7:0/596293592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f1807400640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18081039b0 0x7f180819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 -- 172.21.15.7:0/596293592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18081039b0 msgr2=0x7f180819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18081039b0 0x7f180819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 -- 172.21.15.7:0/596293592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1808101e00 msgr2=0x7f1808197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1808101e00 0x7f1808197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f17fe000640 1 -- 172.21.15.7:0/596293592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009560 con 0x7f1808102ff0 2024-09-13T18:15:13.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.729+0000 7f1806a00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1808101e00 0x7f1808197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:13.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.730+0000 7f17fe000640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808102ff0 0x7f1808198380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9f0 tx=0x7f17f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:13.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.730+0000 7f17ffe00640 1 -- 172.21.15.7:0/596293592 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0009700 con 0x7f1808102ff0 2024-09-13T18:15:13.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.730+0000 7f17ffe00640 1 -- 172.21.15.7:0/596293592 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17f000cd80 con 0x7f1808102ff0 2024-09-13T18:15:13.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.730+0000 7f17ffe00640 1 -- 172.21.15.7:0/596293592 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0018860 con 0x7f1808102ff0 2024-09-13T18:15:13.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.730+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180819ff40 con 0x7f1808102ff0 2024-09-13T18:15:13.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.730+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18081a03c0 con 0x7f1808102ff0 2024-09-13T18:15:13.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.731+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1808109280 con 0x7f1808102ff0 2024-09-13T18:15:13.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.733+0000 7f17ffe00640 1 -- 172.21.15.7:0/596293592 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f17f00189c0 con 0x7f1808102ff0 2024-09-13T18:15:13.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.734+0000 7f17ffe00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17ec0a11a0 0x7f17ec0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.735+0000 7f17ffe00640 1 -- 172.21.15.7:0/596293592 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f17f0014070 con 0x7f1808102ff0 2024-09-13T18:15:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.735+0000 7f1806a00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17ec0a11a0 0x7f17ec0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.735+0000 7f1806a00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17ec0a11a0 0x7f17ec0a3660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17f8031500 tx=0x7f17f8005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:13.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.738+0000 7f17ffe00640 1 -- 172.21.15.7:0/596293592 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f17f0052e20 con 0x7f1808102ff0 2024-09-13T18:15:13.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.922+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f180810d710 con 0x7f1808102ff0 2024-09-13T18:15:13.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.923+0000 7f17ffe00640 1 -- 172.21.15.7:0/596293592 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+21989 (secure 0 0 0) 0x7f17f00963c0 con 0x7f1808102ff0 2024-09-13T18:15:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:13.926 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:15:07.004369+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17ec0a11a0 msgr2=0x7f17ec0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17ec0a11a0 0x7f17ec0a3660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17f8031500 tx=0x7f17f8005780 comp rx=0 tx=0).stop 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808102ff0 msgr2=0x7f1808198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808102ff0 0x7f1808198380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9f0 tx=0x7f17f000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 shutdown_connections 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17ec0a11a0 0x7f17ec0a3660 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18081039b0 0x7f180819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1808102ff0 0x7f1808198380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 --2- 172.21.15.7:0/596293592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1808101e00 0x7f1808197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 >> 172.21.15.7:0/596293592 conn(0x7f18080fd580 msgr2=0x7f1808106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.925+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 shutdown_connections 2024-09-13T18:15:13.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:13.926+0000 7f1807e00640 1 -- 172.21.15.7:0/596293592 wait complete. 2024-09-13T18:15:13.945 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:15:13.945 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:15:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.105+0000 7f31eca00640 1 -- 172.21.15.7:0/2998571768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e80744f0 msgr2=0x7f31e8072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.105+0000 7f31eca00640 1 --2- 172.21.15.7:0/2998571768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e80744f0 0x7f31e8072940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009900 tx=0x7f31d802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.105+0000 7f31eca00640 1 -- 172.21.15.7:0/2998571768 shutdown_connections 2024-09-13T18:15:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.105+0000 7f31eca00640 1 --2- 172.21.15.7:0/2998571768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e810c1c0 0x7f31e810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.105+0000 7f31eca00640 1 --2- 172.21.15.7:0/2998571768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31e8072f10 0x7f31e8073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.105+0000 7f31eca00640 1 --2- 172.21.15.7:0/2998571768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e80744f0 0x7f31e8072940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.105+0000 7f31eca00640 1 -- 172.21.15.7:0/2998571768 >> 172.21.15.7:0/2998571768 conn(0x7f31e80fb390 msgr2=0x7f31e80fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.106+0000 7f31eca00640 1 -- 172.21.15.7:0/2998571768 shutdown_connections 2024-09-13T18:15:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.106+0000 7f31eca00640 1 -- 172.21.15.7:0/2998571768 wait complete. 2024-09-13T18:15:14.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.106+0000 7f31eca00640 1 Processor -- start 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31eca00640 1 -- start start 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31eca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e8072f10 0x7f31e819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31eca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31e80744f0 0x7f31e819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31eca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e810c1c0 0x7f31e81a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31eca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81a3d10 con 0x7f31e80744f0 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31eca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81a3e80 con 0x7f31e8072f10 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31eca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81a4040 con 0x7f31e810c1c0 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31e7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e8072f10 0x7f31e819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31e6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31e80744f0 0x7f31e819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31e7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e8072f10 0x7f31e819c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:58420/0 (socket says 172.21.15.7:58420) 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31e7400640 1 -- 172.21.15.7:0/705485323 learned_addr learned my addr 172.21.15.7:0/705485323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:14.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.107+0000 7f31e7e00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e810c1c0 0x7f31e81a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31e7400640 1 -- 172.21.15.7:0/705485323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e810c1c0 msgr2=0x7f31e81a37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31e7400640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e810c1c0 0x7f31e81a37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31e7400640 1 -- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31e80744f0 msgr2=0x7f31e819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31e7400640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31e80744f0 0x7f31e819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31e7400640 1 -- 172.21.15.7:0/705485323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009560 con 0x7f31e8072f10 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31e7400640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e8072f10 0x7f31e819c220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f31d8031500 tx=0x7f31d8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31dfe00640 1 -- 172.21.15.7:0/705485323 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8003e00 con 0x7f31e8072f10 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e81a42c0 con 0x7f31e8072f10 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31dfe00640 1 -- 172.21.15.7:0/705485323 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31d8031c70 con 0x7f31e8072f10 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31dfe00640 1 -- 172.21.15.7:0/705485323 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d803bc20 con 0x7f31e8072f10 2024-09-13T18:15:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.108+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e81a47c0 con 0x7f31e8072f10 2024-09-13T18:15:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.109+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e8101b60 con 0x7f31e8072f10 2024-09-13T18:15:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.111+0000 7f31dfe00640 1 -- 172.21.15.7:0/705485323 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f31d80317b0 con 0x7f31e8072f10 2024-09-13T18:15:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.112+0000 7f31dfe00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f31cc0a1120 0x7f31cc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.112+0000 7f31dfe00640 1 -- 172.21.15.7:0/705485323 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f31d80ed230 con 0x7f31e8072f10 2024-09-13T18:15:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.113+0000 7f31e6a00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f31cc0a1120 0x7f31cc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.113+0000 7f31e6a00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f31cc0a1120 0x7f31cc0a35e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f31e819d730 tx=0x7f31d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:14.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.116+0000 7f31dfe00640 1 -- 172.21.15.7:0/705485323 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f31d80b69c0 con 0x7f31e8072f10 2024-09-13T18:15:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:14 smithi007 ceph-mon[30588]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:14 smithi007 ceph-mon[30588]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T18:15:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:14 smithi007 ceph-mon[30588]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:14 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/270941950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:14 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/596293592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:14.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.292+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31e80608f0 con 0x7f31cc0a1120 2024-09-13T18:15:14.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.304+0000 7f31dfe00640 1 -- 172.21.15.7:0/705485323 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335991 (secure 0 0 0) 0x7f31e80608f0 con 0x7f31cc0a1120 2024-09-13T18:15:14.311 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:14.313 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f31cc0a1120 msgr2=0x7f31cc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f31cc0a1120 0x7f31cc0a35e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f31e819d730 tx=0x7f31d4005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e8072f10 msgr2=0x7f31e819c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e8072f10 0x7f31e819c220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f31d8031500 tx=0x7f31d8003c10 comp rx=0 tx=0).stop 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 shutdown_connections 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f31cc0a1120 0x7f31cc0a35e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31e810c1c0 0x7f31e81a37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31e80744f0 0x7f31e819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 --2- 172.21.15.7:0/705485323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31e8072f10 0x7f31e819c220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 >> 172.21.15.7:0/705485323 conn(0x7f31e80fb390 msgr2=0x7f31e80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 shutdown_connections 2024-09-13T18:15:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.308+0000 7f31eca00640 1 -- 172.21.15.7:0/705485323 wait complete. 2024-09-13T18:15:14.327 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-13T18:15:12.508351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":613691,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":300,"num_write_kb":2995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":254,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365632,"kb_used_data":12732,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124576192,"statfs":{"total":1151940427776,"available":1151566020608,"internally_reserved":0,"allocated":13037568,"data_stored":7090429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":361215301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23323,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.959732"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077990+0000","last_change":"2024-09-13T18:15:06.044297+0000","last_active":"2024-09-13T18:15:06.077990+0000","last_peered":"2024-09-13T18:15:06.077990+0000","last_clean":"2024-09-13T18:15:06.077990+0000","last_became_active":"2024-09-13T18:15:06.043984+0000","last_became_peered":"2024-09-13T18:15:06.043984+0000","last_unstale":"2024-09-13T18:15:06.077990+0000","last_undegraded":"2024-09-13T18:15:06.077990+0000","last_fullsized":"2024-09-13T18:15:06.077990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:39.469599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060105+0000","last_change":"2024-09-13T18:15:06.038427+0000","last_active":"2024-09-13T18:15:06.060105+0000","last_peered":"2024-09-13T18:15:06.060105+0000","last_clean":"2024-09-13T18:15:06.060105+0000","last_became_active":"2024-09-13T18:15:06.038112+0000","last_became_peered":"2024-09-13T18:15:06.038112+0000","last_unstale":"2024-09-13T18:15:06.060105+0000","last_undegraded":"2024-09-13T18:15:06.060105+0000","last_fullsized":"2024-09-13T18:15:06.060105+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:40.892099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060096+0000","last_change":"2024-09-13T18:15:06.035197+0000","last_active":"2024-09-13T18:15:06.060096+0000","last_peered":"2024-09-13T18:15:06.060096+0000","last_clean":"2024-09-13T18:15:06.060096+0000","last_became_active":"2024-09-13T18:15:06.029918+0000","last_became_peered":"2024-09-13T18:15:06.029918+0000","last_unstale":"2024-09-13T18:15:06.060096+0000","last_undegraded":"2024-09-13T18:15:06.060096+0000","last_fullsized":"2024-09-13T18:15:06.060096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:46.482020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.031948+0000","last_change":"2024-09-13T18:15:06.030482+0000","last_active":"2024-09-13T18:15:06.031948+0000","last_peered":"2024-09-13T18:15:06.031948+0000","last_clean":"2024-09-13T18:15:06.031948+0000","last_became_active":"2024-09-13T18:15:06.029980+0000","last_became_peered":"2024-09-13T18:15:06.029980+0000","last_unstale":"2024-09-13T18:15:06.031948+0000","last_undegraded":"2024-09-13T18:15:06.031948+0000","last_fullsized":"2024-09-13T18:15:06.031948+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:04.488837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842065+0000","last_change":"2024-09-13T18:15:06.027624+0000","last_active":"2024-09-13T18:15:06.842065+0000","last_peered":"2024-09-13T18:15:06.842065+0000","last_clean":"2024-09-13T18:15:06.842065+0000","last_became_active":"2024-09-13T18:15:06.027353+0000","last_became_peered":"2024-09-13T18:15:06.027353+0000","last_unstale":"2024-09-13T18:15:06.842065+0000","last_undegraded":"2024-09-13T18:15:06.842065+0000","last_fullsized":"2024-09-13T18:15:06.842065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:30.159234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.178930+0000","last_change":"2024-09-13T18:15:06.026446+0000","last_active":"2024-09-13T18:15:07.178930+0000","last_peered":"2024-09-13T18:15:07.178930+0000","last_clean":"2024-09-13T18:15:07.178930+0000","last_became_active":"2024-09-13T18:15:06.026115+0000","last_became_peered":"2024-09-13T18:15:06.026115+0000","last_unstale":"2024-09-13T18:15:07.178930+0000","last_undegraded":"2024-09-13T18:15:07.178930+0000","last_fullsized":"2024-09-13T18:15:07.178930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:26.449382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927393+0000","last_change":"2024-09-13T18:15:06.019147+0000","last_active":"2024-09-13T18:15:07.927393+0000","last_peered":"2024-09-13T18:15:07.927393+0000","last_clean":"2024-09-13T18:15:07.927393+0000","last_became_active":"2024-09-13T18:15:06.018239+0000","last_became_peered":"2024-09-13T18:15:06.018239+0000","last_unstale":"2024-09-13T18:15:07.927393+0000","last_undegraded":"2024-09-13T18:15:07.927393+0000","last_fullsized":"2024-09-13T18:15:07.927393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:31.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008289+0000","last_change":"2024-09-13T18:15:06.029615+0000","last_active":"2024-09-13T18:15:07.008289+0000","last_peered":"2024-09-13T18:15:07.008289+0000","last_clean":"2024-09-13T18:15:07.008289+0000","last_became_active":"2024-09-13T18:15:06.029351+0000","last_became_peered":"2024-09-13T18:15:06.029351+0000","last_unstale":"2024-09-13T18:15:07.008289+0000","last_undegraded":"2024-09-13T18:15:07.008289+0000","last_fullsized":"2024-09-13T18:15:07.008289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:36.533097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.659071+0000","last_change":"2024-09-13T18:15:06.022623+0000","last_active":"2024-09-13T18:15:07.659071+0000","last_peered":"2024-09-13T18:15:07.659071+0000","last_clean":"2024-09-13T18:15:07.659071+0000","last_became_active":"2024-09-13T18:15:06.022338+0000","last_became_peered":"2024-09-13T18:15:06.022338+0000","last_unstale":"2024-09-13T18:15:07.659071+0000","last_undegraded":"2024-09-13T18:15:07.659071+0000","last_fullsized":"2024-09-13T18:15:07.659071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:24.658524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.179041+0000","last_change":"2024-09-13T18:15:06.025226+0000","last_active":"2024-09-13T18:15:07.179041+0000","last_peered":"2024-09-13T18:15:07.179041+0000","last_clean":"2024-09-13T18:15:07.179041+0000","last_became_active":"2024-09-13T18:15:06.024910+0000","last_became_peered":"2024-09-13T18:15:06.024910+0000","last_unstale":"2024-09-13T18:15:07.179041+0000","last_undegraded":"2024-09-13T18:15:07.179041+0000","last_fullsized":"2024-09-13T18:15:07.179041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:43.548175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927826+0000","last_change":"2024-09-13T18:15:06.028140+0000","last_active":"2024-09-13T18:15:07.927826+0000","last_peered":"2024-09-13T18:15:07.927826+0000","last_clean":"2024-09-13T18:15:07.927826+0000","last_became_active":"2024-09-13T18:15:06.027774+0000","last_became_peered":"2024-09-13T18:15:06.027774+0000","last_unstale":"2024-09-13T18:15:07.927826+0000","last_undegraded":"2024-09-13T18:15:07.927826+0000","last_fullsized":"2024-09-13T18:15:07.927826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:34.454084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.030961+0000","last_change":"2024-09-13T18:15:06.030264+0000","last_active":"2024-09-13T18:15:06.030961+0000","last_peered":"2024-09-13T18:15:06.030961+0000","last_clean":"2024-09-13T18:15:06.030961+0000","last_became_active":"2024-09-13T18:15:06.029571+0000","last_became_peered":"2024-09-13T18:15:06.029571+0000","last_unstale":"2024-09-13T18:15:06.030961+0000","last_undegraded":"2024-09-13T18:15:06.030961+0000","last_fullsized":"2024-09-13T18:15:06.030961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:15.545277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.034205+0000","last_change":"2024-09-13T18:15:06.029189+0000","last_active":"2024-09-13T18:15:06.034205+0000","last_peered":"2024-09-13T18:15:06.034205+0000","last_clean":"2024-09-13T18:15:06.034205+0000","last_became_active":"2024-09-13T18:15:06.028834+0000","last_became_peered":"2024-09-13T18:15:06.028834+0000","last_unstale":"2024-09-13T18:15:06.034205+0000","last_undegraded":"2024-09-13T18:15:06.034205+0000","last_fullsized":"2024-09-13T18:15:06.034205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:21.744826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060077+0000","last_change":"2024-09-13T18:15:06.044048+0000","last_active":"2024-09-13T18:15:06.060077+0000","last_peered":"2024-09-13T18:15:06.060077+0000","last_clean":"2024-09-13T18:15:06.060077+0000","last_became_active":"2024-09-13T18:15:06.043292+0000","last_became_peered":"2024-09-13T18:15:06.043292+0000","last_unstale":"2024-09-13T18:15:06.060077+0000","last_undegraded":"2024-09-13T18:15:06.060077+0000","last_fullsized":"2024-09-13T18:15:06.060077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:41.788308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060062+0000","last_change":"2024-09-13T18:15:06.033817+0000","last_active":"2024-09-13T18:15:06.060062+0000","last_peered":"2024-09-13T18:15:06.060062+0000","last_clean":"2024-09-13T18:15:06.060062+0000","last_became_active":"2024-09-13T18:15:06.033507+0000","last_became_peered":"2024-09-13T18:15:06.033507+0000","last_unstale":"2024-09-13T18:15:06.060062+0000","last_undegraded":"2024-09-13T18:15:06.060062+0000","last_fullsized":"2024-09-13T18:15:06.060062+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:15.197681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658610+0000","last_change":"2024-09-13T18:15:06.032811+0000","last_active":"2024-09-13T18:15:07.658610+0000","last_peered":"2024-09-13T18:15:07.658610+0000","last_clean":"2024-09-13T18:15:07.658610+0000","last_became_active":"2024-09-13T18:15:06.032444+0000","last_became_peered":"2024-09-13T18:15:06.032444+0000","last_unstale":"2024-09-13T18:15:07.658610+0000","last_undegraded":"2024-09-13T18:15:07.658610+0000","last_fullsized":"2024-09-13T18:15:07.658610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:37.214417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077996+0000","last_change":"2024-09-13T18:15:06.040484+0000","last_active":"2024-09-13T18:15:06.077996+0000","last_peered":"2024-09-13T18:15:06.077996+0000","last_clean":"2024-09-13T18:15:06.077996+0000","last_became_active":"2024-09-13T18:15:06.040235+0000","last_became_peered":"2024-09-13T18:15:06.040235+0000","last_unstale":"2024-09-13T18:15:06.077996+0000","last_undegraded":"2024-09-13T18:15:06.077996+0000","last_fullsized":"2024-09-13T18:15:06.077996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:12.266079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658604+0000","last_change":"2024-09-13T18:15:06.019137+0000","last_active":"2024-09-13T18:15:07.658604+0000","last_peered":"2024-09-13T18:15:07.658604+0000","last_clean":"2024-09-13T18:15:07.658604+0000","last_became_active":"2024-09-13T18:15:06.018554+0000","last_became_peered":"2024-09-13T18:15:06.018554+0000","last_unstale":"2024-09-13T18:15:07.658604+0000","last_undegraded":"2024-09-13T18:15:07.658604+0000","last_fullsized":"2024-09-13T18:15:07.658604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:14.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157418+0000","last_change":"2024-09-13T18:15:06.026643+0000","last_active":"2024-09-13T18:15:07.157418+0000","last_peered":"2024-09-13T18:15:07.157418+0000","last_clean":"2024-09-13T18:15:07.157418+0000","last_became_active":"2024-09-13T18:15:06.026024+0000","last_became_peered":"2024-09-13T18:15:06.026024+0000","last_unstale":"2024-09-13T18:15:07.157418+0000","last_undegraded":"2024-09-13T18:15:07.157418+0000","last_fullsized":"2024-09-13T18:15:07.157418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:16.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077961+0000","last_change":"2024-09-13T18:15:06.025101+0000","last_active":"2024-09-13T18:15:06.077961+0000","last_peered":"2024-09-13T18:15:06.077961+0000","last_clean":"2024-09-13T18:15:06.077961+0000","last_became_active":"2024-09-13T18:15:06.024810+0000","last_became_peered":"2024-09-13T18:15:06.024810+0000","last_unstale":"2024-09-13T18:15:06.077961+0000","last_undegraded":"2024-09-13T18:15:06.077961+0000","last_fullsized":"2024-09-13T18:15:06.077961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.347722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.047774+0000","last_change":"2024-09-13T18:15:06.044817+0000","last_active":"2024-09-13T18:15:06.047774+0000","last_peered":"2024-09-13T18:15:06.047774+0000","last_clean":"2024-09-13T18:15:06.047774+0000","last_became_active":"2024-09-13T18:15:06.044485+0000","last_became_peered":"2024-09-13T18:15:06.044485+0000","last_unstale":"2024-09-13T18:15:06.047774+0000","last_undegraded":"2024-09-13T18:15:06.047774+0000","last_fullsized":"2024-09-13T18:15:06.047774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:25.622237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658845+0000","last_change":"2024-09-13T18:15:06.030149+0000","last_active":"2024-09-13T18:15:07.658845+0000","last_peered":"2024-09-13T18:15:07.658845+0000","last_clean":"2024-09-13T18:15:07.658845+0000","last_became_active":"2024-09-13T18:15:06.029830+0000","last_became_peered":"2024-09-13T18:15:06.029830+0000","last_unstale":"2024-09-13T18:15:07.658845+0000","last_undegraded":"2024-09-13T18:15:07.658845+0000","last_fullsized":"2024-09-13T18:15:07.658845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:37.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008406+0000","last_change":"2024-09-13T18:15:06.032485+0000","last_active":"2024-09-13T18:15:07.008406+0000","last_peered":"2024-09-13T18:15:07.008406+0000","last_clean":"2024-09-13T18:15:07.008406+0000","last_became_active":"2024-09-13T18:15:06.032041+0000","last_became_peered":"2024-09-13T18:15:06.032041+0000","last_unstale":"2024-09-13T18:15:07.008406+0000","last_undegraded":"2024-09-13T18:15:07.008406+0000","last_fullsized":"2024-09-13T18:15:07.008406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:09.793771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008298+0000","last_change":"2024-09-13T18:15:06.020133+0000","last_active":"2024-09-13T18:15:07.008298+0000","last_peered":"2024-09-13T18:15:07.008298+0000","last_clean":"2024-09-13T18:15:07.008298+0000","last_became_active":"2024-09-13T18:15:06.019829+0000","last_became_peered":"2024-09-13T18:15:06.019829+0000","last_unstale":"2024-09-13T18:15:07.008298+0000","last_undegraded":"2024-09-13T18:15:07.008298+0000","last_fullsized":"2024-09-13T18:15:07.008298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:27.635560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008867+0000","last_change":"2024-09-13T18:15:06.026796+0000","last_active":"2024-09-13T18:15:07.008867+0000","last_peered":"2024-09-13T18:15:07.008867+0000","last_clean":"2024-09-13T18:15:07.008867+0000","last_became_active":"2024-09-13T18:15:06.026449+0000","last_became_peered":"2024-09-13T18:15:06.026449+0000","last_unstale":"2024-09-13T18:15:07.008867+0000","last_undegraded":"2024-09-13T18:15:07.008867+0000","last_fullsized":"2024-09-13T18:15:07.008867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:09.825997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157450+0000","last_change":"2024-09-13T18:15:06.019787+0000","last_active":"2024-09-13T18:15:07.157450+0000","last_peered":"2024-09-13T18:15:07.157450+0000","last_clean":"2024-09-13T18:15:07.157450+0000","last_became_active":"2024-09-13T18:15:06.019514+0000","last_became_peered":"2024-09-13T18:15:06.019514+0000","last_unstale":"2024-09-13T18:15:07.157450+0000","last_undegraded":"2024-09-13T18:15:07.157450+0000","last_fullsized":"2024-09-13T18:15:07.157450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:05.614832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077970+0000","last_change":"2024-09-13T18:15:06.024397+0000","last_active":"2024-09-13T18:15:06.077970+0000","last_peered":"2024-09-13T18:15:06.077970+0000","last_clean":"2024-09-13T18:15:06.077970+0000","last_became_active":"2024-09-13T18:15:06.024089+0000","last_became_peered":"2024-09-13T18:15:06.024089+0000","last_unstale":"2024-09-13T18:15:06.077970+0000","last_undegraded":"2024-09-13T18:15:06.077970+0000","last_fullsized":"2024-09-13T18:15:06.077970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:42.590652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.047786+0000","last_change":"2024-09-13T18:15:06.045070+0000","last_active":"2024-09-13T18:15:06.047786+0000","last_peered":"2024-09-13T18:15:06.047786+0000","last_clean":"2024-09-13T18:15:06.047786+0000","last_became_active":"2024-09-13T18:15:06.044098+0000","last_became_peered":"2024-09-13T18:15:06.044098+0000","last_unstale":"2024-09-13T18:15:06.047786+0000","last_undegraded":"2024-09-13T18:15:06.047786+0000","last_fullsized":"2024-09-13T18:15:06.047786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:53.943354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060087+0000","last_change":"2024-09-13T18:15:06.038938+0000","last_active":"2024-09-13T18:15:06.060087+0000","last_peered":"2024-09-13T18:15:06.060087+0000","last_clean":"2024-09-13T18:15:06.060087+0000","last_became_active":"2024-09-13T18:15:06.038432+0000","last_became_peered":"2024-09-13T18:15:06.038432+0000","last_unstale":"2024-09-13T18:15:06.060087+0000","last_undegraded":"2024-09-13T18:15:06.060087+0000","last_fullsized":"2024-09-13T18:15:06.060087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.339859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157190+0000","last_change":"2024-09-13T18:15:06.044302+0000","last_active":"2024-09-13T18:15:07.157190+0000","last_peered":"2024-09-13T18:15:07.157190+0000","last_clean":"2024-09-13T18:15:07.157190+0000","last_became_active":"2024-09-13T18:15:06.043959+0000","last_became_peered":"2024-09-13T18:15:06.043959+0000","last_unstale":"2024-09-13T18:15:07.157190+0000","last_undegraded":"2024-09-13T18:15:07.157190+0000","last_fullsized":"2024-09-13T18:15:07.157190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:06.271075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157212+0000","last_change":"2024-09-13T18:15:06.017040+0000","last_active":"2024-09-13T18:15:07.157212+0000","last_peered":"2024-09-13T18:15:07.157212+0000","last_clean":"2024-09-13T18:15:07.157212+0000","last_became_active":"2024-09-13T18:15:06.016710+0000","last_became_peered":"2024-09-13T18:15:06.016710+0000","last_unstale":"2024-09-13T18:15:07.157212+0000","last_undegraded":"2024-09-13T18:15:07.157212+0000","last_fullsized":"2024-09-13T18:15:07.157212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:07.214004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077940+0000","last_change":"2024-09-13T18:15:06.023969+0000","last_active":"2024-09-13T18:15:06.077940+0000","last_peered":"2024-09-13T18:15:06.077940+0000","last_clean":"2024-09-13T18:15:06.077940+0000","last_became_active":"2024-09-13T18:15:06.023641+0000","last_became_peered":"2024-09-13T18:15:06.023641+0000","last_unstale":"2024-09-13T18:15:06.077940+0000","last_undegraded":"2024-09-13T18:15:06.077940+0000","last_fullsized":"2024-09-13T18:15:06.077940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:27.188715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842030+0000","last_change":"2024-09-13T18:15:06.021576+0000","last_active":"2024-09-13T18:15:06.842030+0000","last_peered":"2024-09-13T18:15:06.842030+0000","last_clean":"2024-09-13T18:15:06.842030+0000","last_became_active":"2024-09-13T18:15:06.018911+0000","last_became_peered":"2024-09-13T18:15:06.018911+0000","last_unstale":"2024-09-13T18:15:06.842030+0000","last_undegraded":"2024-09-13T18:15:06.842030+0000","last_fullsized":"2024-09-13T18:15:06.842030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:04.669568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008513+0000","last_change":"2024-09-13T18:15:05.568259+0000","last_active":"2024-09-13T18:15:07.008513+0000","last_peered":"2024-09-13T18:15:07.008513+0000","last_clean":"2024-09-13T18:15:07.008513+0000","last_became_active":"2024-09-13T18:15:05.567888+0000","last_became_peered":"2024-09-13T18:15:05.567888+0000","last_unstale":"2024-09-13T18:15:07.008513+0000","last_undegraded":"2024-09-13T18:15:07.008513+0000","last_fullsized":"2024-09-13T18:15:07.008513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:50.942167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008328+0000","last_change":"2024-09-13T18:15:06.025868+0000","last_active":"2024-09-13T18:15:07.008328+0000","last_peered":"2024-09-13T18:15:07.008328+0000","last_clean":"2024-09-13T18:15:07.008328+0000","last_became_active":"2024-09-13T18:15:06.025583+0000","last_became_peered":"2024-09-13T18:15:06.025583+0000","last_unstale":"2024-09-13T18:15:07.008328+0000","last_undegraded":"2024-09-13T18:15:07.008328+0000","last_fullsized":"2024-09-13T18:15:07.008328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:15.774579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.055742+0000","last_change":"2024-09-13T18:15:05.570260+0000","last_active":"2024-09-13T18:15:11.055742+0000","last_peered":"2024-09-13T18:15:11.055742+0000","last_clean":"2024-09-13T18:15:11.055742+0000","last_became_active":"2024-09-13T18:15:05.569942+0000","last_became_peered":"2024-09-13T18:15:05.569942+0000","last_unstale":"2024-09-13T18:15:11.055742+0000","last_undegraded":"2024-09-13T18:15:11.055742+0000","last_fullsized":"2024-09-13T18:15:11.055742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:24.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.044485+0000","last_change":"2024-09-13T18:15:05.568010+0000","last_active":"2024-09-13T18:15:10.044485+0000","last_peered":"2024-09-13T18:15:10.044485+0000","last_clean":"2024-09-13T18:15:10.044485+0000","last_became_active":"2024-09-13T18:15:05.567415+0000","last_became_peered":"2024-09-13T18:15:05.567415+0000","last_unstale":"2024-09-13T18:15:10.044485+0000","last_undegraded":"2024-09-13T18:15:10.044485+0000","last_fullsized":"2024-09-13T18:15:10.044485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:26.873148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008717+0000","last_change":"2024-09-13T18:15:06.034747+0000","last_active":"2024-09-13T18:15:07.008717+0000","last_peered":"2024-09-13T18:15:07.008717+0000","last_clean":"2024-09-13T18:15:07.008717+0000","last_became_active":"2024-09-13T18:15:06.034471+0000","last_became_peered":"2024-09-13T18:15:06.034471+0000","last_unstale":"2024-09-13T18:15:07.008717+0000","last_undegraded":"2024-09-13T18:15:07.008717+0000","last_fullsized":"2024-09-13T18:15:07.008717+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:25.493842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008399+0000","last_change":"2024-09-13T18:15:05.562831+0000","last_active":"2024-09-13T18:15:07.008399+0000","last_peered":"2024-09-13T18:15:07.008399+0000","last_clean":"2024-09-13T18:15:07.008399+0000","last_became_active":"2024-09-13T18:15:05.562530+0000","last_became_peered":"2024-09-13T18:15:05.562530+0000","last_unstale":"2024-09-13T18:15:07.008399+0000","last_undegraded":"2024-09-13T18:15:07.008399+0000","last_fullsized":"2024-09-13T18:15:07.008399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:00.696204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.659061+0000","last_change":"2024-09-13T18:15:06.019843+0000","last_active":"2024-09-13T18:15:07.659061+0000","last_peered":"2024-09-13T18:15:07.659061+0000","last_clean":"2024-09-13T18:15:07.659061+0000","last_became_active":"2024-09-13T18:15:06.019210+0000","last_became_peered":"2024-09-13T18:15:06.019210+0000","last_unstale":"2024-09-13T18:15:07.659061+0000","last_undegraded":"2024-09-13T18:15:07.659061+0000","last_fullsized":"2024-09-13T18:15:07.659061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:05.552674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.038146+0000","last_change":"2024-09-13T18:15:05.567185+0000","last_active":"2024-09-13T18:15:09.038146+0000","last_peered":"2024-09-13T18:15:09.038146+0000","last_clean":"2024-09-13T18:15:09.038146+0000","last_became_active":"2024-09-13T18:15:05.566489+0000","last_became_peered":"2024-09-13T18:15:05.566489+0000","last_unstale":"2024-09-13T18:15:09.038146+0000","last_undegraded":"2024-09-13T18:15:09.038146+0000","last_fullsized":"2024-09-13T18:15:09.038146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:57.976621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658750+0000","last_change":"2024-09-13T18:15:06.021551+0000","last_active":"2024-09-13T18:15:07.658750+0000","last_peered":"2024-09-13T18:15:07.658750+0000","last_clean":"2024-09-13T18:15:07.658750+0000","last_became_active":"2024-09-13T18:15:06.021097+0000","last_became_peered":"2024-09-13T18:15:06.021097+0000","last_unstale":"2024-09-13T18:15:07.658750+0000","last_undegraded":"2024-09-13T18:15:07.658750+0000","last_fullsized":"2024-09-13T18:15:07.658750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:06.392812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927693+0000","last_change":"2024-09-13T18:15:05.567190+0000","last_active":"2024-09-13T18:15:07.927693+0000","last_peered":"2024-09-13T18:15:07.927693+0000","last_clean":"2024-09-13T18:15:07.927693+0000","last_became_active":"2024-09-13T18:15:05.566877+0000","last_became_peered":"2024-09-13T18:15:05.566877+0000","last_unstale":"2024-09-13T18:15:07.927693+0000","last_undegraded":"2024-09-13T18:15:07.927693+0000","last_fullsized":"2024-09-13T18:15:07.927693+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:59.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060131+0000","last_change":"2024-09-13T18:15:06.031161+0000","last_active":"2024-09-13T18:15:06.060131+0000","last_peered":"2024-09-13T18:15:06.060131+0000","last_clean":"2024-09-13T18:15:06.060131+0000","last_became_active":"2024-09-13T18:15:06.030863+0000","last_became_peered":"2024-09-13T18:15:06.030863+0000","last_unstale":"2024-09-13T18:15:06.060131+0000","last_undegraded":"2024-09-13T18:15:06.060131+0000","last_fullsized":"2024-09-13T18:15:06.060131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:08.786051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008525+0000","last_change":"2024-09-13T18:15:05.579918+0000","last_active":"2024-09-13T18:15:07.008525+0000","last_peered":"2024-09-13T18:15:07.008525+0000","last_clean":"2024-09-13T18:15:07.008525+0000","last_became_active":"2024-09-13T18:15:05.579542+0000","last_became_peered":"2024-09-13T18:15:05.579542+0000","last_unstale":"2024-09-13T18:15:07.008525+0000","last_undegraded":"2024-09-13T18:15:07.008525+0000","last_fullsized":"2024-09-13T18:15:07.008525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:11.000542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658635+0000","last_change":"2024-09-13T18:15:06.028298+0000","last_active":"2024-09-13T18:15:07.658635+0000","last_peered":"2024-09-13T18:15:07.658635+0000","last_clean":"2024-09-13T18:15:07.658635+0000","last_became_active":"2024-09-13T18:15:06.027978+0000","last_became_peered":"2024-09-13T18:15:06.027978+0000","last_unstale":"2024-09-13T18:15:07.658635+0000","last_undegraded":"2024-09-13T18:15:07.658635+0000","last_fullsized":"2024-09-13T18:15:07.658635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:04.134421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'17","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.060127+0000","last_change":"2024-09-13T18:15:05.569168+0000","last_active":"2024-09-13T18:15:12.060127+0000","last_peered":"2024-09-13T18:15:12.060127+0000","last_clean":"2024-09-13T18:15:12.060127+0000","last_became_active":"2024-09-13T18:15:05.568816+0000","last_became_peered":"2024-09-13T18:15:05.568816+0000","last_unstale":"2024-09-13T18:15:12.060127+0000","last_undegraded":"2024-09-13T18:15:12.060127+0000","last_fullsized":"2024-09-13T18:15:12.060127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:33.113730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20848,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842121+0000","last_change":"2024-09-13T18:15:06.022452+0000","last_active":"2024-09-13T18:15:06.842121+0000","last_peered":"2024-09-13T18:15:06.842121+0000","last_clean":"2024-09-13T18:15:06.842121+0000","last_became_active":"2024-09-13T18:15:06.022167+0000","last_became_peered":"2024-09-13T18:15:06.022167+0000","last_unstale":"2024-09-13T18:15:06.842121+0000","last_undegraded":"2024-09-13T18:15:06.842121+0000","last_fullsized":"2024-09-13T18:15:06.842121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.389512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.044866+0000","last_change":"2024-09-13T18:15:05.575305+0000","last_active":"2024-09-13T18:15:10.044866+0000","last_peered":"2024-09-13T18:15:10.044866+0000","last_clean":"2024-09-13T18:15:10.044866+0000","last_became_active":"2024-09-13T18:15:05.575023+0000","last_became_peered":"2024-09-13T18:15:05.575023+0000","last_unstale":"2024-09-13T18:15:10.044866+0000","last_undegraded":"2024-09-13T18:15:10.044866+0000","last_fullsized":"2024-09-13T18:15:10.044866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.098264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.043268+0000","last_change":"2024-09-13T18:15:06.042275+0000","last_active":"2024-09-13T18:15:06.043268+0000","last_peered":"2024-09-13T18:15:06.043268+0000","last_clean":"2024-09-13T18:15:06.043268+0000","last_became_active":"2024-09-13T18:15:06.041593+0000","last_became_peered":"2024-09-13T18:15:06.041593+0000","last_unstale":"2024-09-13T18:15:06.043268+0000","last_undegraded":"2024-09-13T18:15:06.043268+0000","last_fullsized":"2024-09-13T18:15:06.043268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.550068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008339+0000","last_change":"2024-09-13T18:15:05.569419+0000","last_active":"2024-09-13T18:15:07.008339+0000","last_peered":"2024-09-13T18:15:07.008339+0000","last_clean":"2024-09-13T18:15:07.008339+0000","last_became_active":"2024-09-13T18:15:05.569126+0000","last_became_peered":"2024-09-13T18:15:05.569126+0000","last_unstale":"2024-09-13T18:15:07.008339+0000","last_undegraded":"2024-09-13T18:15:07.008339+0000","last_fullsized":"2024-09-13T18:15:07.008339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:17.133139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927767+0000","last_change":"2024-09-13T18:15:06.029017+0000","last_active":"2024-09-13T18:15:07.927767+0000","last_peered":"2024-09-13T18:15:07.927767+0000","last_clean":"2024-09-13T18:15:07.927767+0000","last_became_active":"2024-09-13T18:15:06.028688+0000","last_became_peered":"2024-09-13T18:15:06.028688+0000","last_unstale":"2024-09-13T18:15:07.927767+0000","last_undegraded":"2024-09-13T18:15:07.927767+0000","last_fullsized":"2024-09-13T18:15:07.927767+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:30.890494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.041715+0000","last_change":"2024-09-13T18:15:05.564102+0000","last_active":"2024-09-13T18:15:10.041715+0000","last_peered":"2024-09-13T18:15:10.041715+0000","last_clean":"2024-09-13T18:15:10.041715+0000","last_became_active":"2024-09-13T18:15:05.563784+0000","last_became_peered":"2024-09-13T18:15:05.563784+0000","last_unstale":"2024-09-13T18:15:10.041715+0000","last_undegraded":"2024-09-13T18:15:10.041715+0000","last_fullsized":"2024-09-13T18:15:10.041715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:38.285940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927678+0000","last_change":"2024-09-13T18:15:06.021229+0000","last_active":"2024-09-13T18:15:07.927678+0000","last_peered":"2024-09-13T18:15:07.927678+0000","last_clean":"2024-09-13T18:15:07.927678+0000","last_became_active":"2024-09-13T18:15:06.021010+0000","last_became_peered":"2024-09-13T18:15:06.021010+0000","last_unstale":"2024-09-13T18:15:07.927678+0000","last_undegraded":"2024-09-13T18:15:07.927678+0000","last_fullsized":"2024-09-13T18:15:07.927678+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:32.149865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'16","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.045253+0000","last_change":"2024-09-13T18:15:05.574442+0000","last_active":"2024-09-13T18:15:10.045253+0000","last_peered":"2024-09-13T18:15:10.045253+0000","last_clean":"2024-09-13T18:15:10.045253+0000","last_became_active":"2024-09-13T18:15:05.574129+0000","last_became_peered":"2024-09-13T18:15:05.574129+0000","last_unstale":"2024-09-13T18:15:10.045253+0000","last_undegraded":"2024-09-13T18:15:10.045253+0000","last_fullsized":"2024-09-13T18:15:10.045253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:26.510710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008239+0000","last_change":"2024-09-13T18:15:06.027258+0000","last_active":"2024-09-13T18:15:07.008239+0000","last_peered":"2024-09-13T18:15:07.008239+0000","last_clean":"2024-09-13T18:15:07.008239+0000","last_became_active":"2024-09-13T18:15:06.026947+0000","last_became_peered":"2024-09-13T18:15:06.026947+0000","last_unstale":"2024-09-13T18:15:07.008239+0000","last_undegraded":"2024-09-13T18:15:07.008239+0000","last_fullsized":"2024-09-13T18:15:07.008239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.227479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842172+0000","last_change":"2024-09-13T18:15:05.561141+0000","last_active":"2024-09-13T18:15:06.842172+0000","last_peered":"2024-09-13T18:15:06.842172+0000","last_clean":"2024-09-13T18:15:06.842172+0000","last_became_active":"2024-09-13T18:15:05.560824+0000","last_became_peered":"2024-09-13T18:15:05.560824+0000","last_unstale":"2024-09-13T18:15:06.842172+0000","last_undegraded":"2024-09-13T18:15:06.842172+0000","last_fullsized":"2024-09-13T18:15:06.842172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:46.213439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077982+0000","last_change":"2024-09-13T18:15:06.020893+0000","last_active":"2024-09-13T18:15:06.077982+0000","last_peered":"2024-09-13T18:15:06.077982+0000","last_clean":"2024-09-13T18:15:06.077982+0000","last_became_active":"2024-09-13T18:15:06.020586+0000","last_became_peered":"2024-09-13T18:15:06.020586+0000","last_unstale":"2024-09-13T18:15:06.077982+0000","last_undegraded":"2024-09-13T18:15:06.077982+0000","last_fullsized":"2024-09-13T18:15:06.077982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:53.793895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.041365+0000","last_change":"2024-09-13T18:15:05.571263+0000","last_active":"2024-09-13T18:15:06.041365+0000","last_peered":"2024-09-13T18:15:06.041365+0000","last_clean":"2024-09-13T18:15:06.041365+0000","last_became_active":"2024-09-13T18:15:05.570520+0000","last_became_peered":"2024-09-13T18:15:05.570520+0000","last_unstale":"2024-09-13T18:15:06.041365+0000","last_undegraded":"2024-09-13T18:15:06.041365+0000","last_fullsized":"2024-09-13T18:15:06.041365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:52.401456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927875+0000","last_change":"2024-09-13T18:15:06.021756+0000","last_active":"2024-09-13T18:15:07.927875+0000","last_peered":"2024-09-13T18:15:07.927875+0000","last_clean":"2024-09-13T18:15:07.927875+0000","last_became_active":"2024-09-13T18:15:06.021398+0000","last_became_peered":"2024-09-13T18:15:06.021398+0000","last_unstale":"2024-09-13T18:15:07.927875+0000","last_undegraded":"2024-09-13T18:15:07.927875+0000","last_fullsized":"2024-09-13T18:15:07.927875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:25.227069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008623+0000","last_change":"2024-09-13T18:15:05.570164+0000","last_active":"2024-09-13T18:15:07.008623+0000","last_peered":"2024-09-13T18:15:07.008623+0000","last_clean":"2024-09-13T18:15:07.008623+0000","last_became_active":"2024-09-13T18:15:05.569799+0000","last_became_peered":"2024-09-13T18:15:05.569799+0000","last_unstale":"2024-09-13T18:15:07.008623+0000","last_undegraded":"2024-09-13T18:15:07.008623+0000","last_fullsized":"2024-09-13T18:15:07.008623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:07.623426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927544+0000","last_change":"2024-09-13T18:15:06.024555+0000","last_active":"2024-09-13T18:15:07.927544+0000","last_peered":"2024-09-13T18:15:07.927544+0000","last_clean":"2024-09-13T18:15:07.927544+0000","last_became_active":"2024-09-13T18:15:06.023855+0000","last_became_peered":"2024-09-13T18:15:06.023855+0000","last_unstale":"2024-09-13T18:15:07.927544+0000","last_undegraded":"2024-09-13T18:15:07.927544+0000","last_fullsized":"2024-09-13T18:15:07.927544+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:04.790167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.042196+0000","last_change":"2024-09-13T18:15:05.578930+0000","last_active":"2024-09-13T18:15:10.042196+0000","last_peered":"2024-09-13T18:15:10.042196+0000","last_clean":"2024-09-13T18:15:10.042196+0000","last_became_active":"2024-09-13T18:15:05.578597+0000","last_became_peered":"2024-09-13T18:15:05.578597+0000","last_unstale":"2024-09-13T18:15:10.042196+0000","last_undegraded":"2024-09-13T18:15:10.042196+0000","last_fullsized":"2024-09-13T18:15:10.042196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:45.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927829+0000","last_change":"2024-09-13T18:15:06.025762+0000","last_active":"2024-09-13T18:15:07.927829+0000","last_peered":"2024-09-13T18:15:07.927829+0000","last_clean":"2024-09-13T18:15:07.927829+0000","last_became_active":"2024-09-13T18:15:06.025523+0000","last_became_peered":"2024-09-13T18:15:06.025523+0000","last_unstale":"2024-09-13T18:15:07.927829+0000","last_undegraded":"2024-09-13T18:15:07.927829+0000","last_fullsized":"2024-09-13T18:15:07.927829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.430133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":326,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.014067+0000","last_change":"2024-09-13T18:13:55.705797+0000","last_active":"2024-09-13T18:15:06.014067+0000","last_peered":"2024-09-13T18:15:06.014067+0000","last_clean":"2024-09-13T18:15:06.014067+0000","last_became_active":"2024-09-13T18:13:55.705398+0000","last_became_peered":"2024-09-13T18:13:55.705398+0000","last_unstale":"2024-09-13T18:15:06.014067+0000","last_undegraded":"2024-09-13T18:15:06.014067+0000","last_fullsized":"2024-09-13T18:15:06.014067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_clean_scrub_stamp":"2024-09-13T18:10:37.078709+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:10.923431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.039295+0000","last_change":"2024-09-13T18:15:05.561809+0000","last_active":"2024-09-13T18:15:09.039295+0000","last_peered":"2024-09-13T18:15:09.039295+0000","last_clean":"2024-09-13T18:15:09.039295+0000","last_became_active":"2024-09-13T18:15:05.561493+0000","last_became_peered":"2024-09-13T18:15:05.561493+0000","last_unstale":"2024-09-13T18:15:09.039295+0000","last_undegraded":"2024-09-13T18:15:09.039295+0000","last_fullsized":"2024-09-13T18:15:09.039295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.166893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008658+0000","last_change":"2024-09-13T18:15:06.029613+0000","last_active":"2024-09-13T18:15:07.008658+0000","last_peered":"2024-09-13T18:15:07.008658+0000","last_clean":"2024-09-13T18:15:07.008658+0000","last_became_active":"2024-09-13T18:15:06.024766+0000","last_became_peered":"2024-09-13T18:15:06.024766+0000","last_unstale":"2024-09-13T18:15:07.008658+0000","last_undegraded":"2024-09-13T18:15:07.008658+0000","last_fullsized":"2024-09-13T18:15:07.008658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:35.673463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927708+0000","last_change":"2024-09-13T18:15:05.564512+0000","last_active":"2024-09-13T18:15:07.927708+0000","last_peered":"2024-09-13T18:15:07.927708+0000","last_clean":"2024-09-13T18:15:07.927708+0000","last_became_active":"2024-09-13T18:15:05.561695+0000","last_became_peered":"2024-09-13T18:15:05.561695+0000","last_unstale":"2024-09-13T18:15:07.927708+0000","last_undegraded":"2024-09-13T18:15:07.927708+0000","last_fullsized":"2024-09-13T18:15:07.927708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:45.537500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.036639+0000","last_change":"2024-09-13T18:15:06.034056+0000","last_active":"2024-09-13T18:15:06.036639+0000","last_peered":"2024-09-13T18:15:06.036639+0000","last_clean":"2024-09-13T18:15:06.036639+0000","last_became_active":"2024-09-13T18:15:06.030633+0000","last_became_peered":"2024-09-13T18:15:06.030633+0000","last_unstale":"2024-09-13T18:15:06.036639+0000","last_undegraded":"2024-09-13T18:15:06.036639+0000","last_fullsized":"2024-09-13T18:15:06.036639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:58.462828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.045433+0000","last_change":"2024-09-13T18:15:05.576585+0000","last_active":"2024-09-13T18:15:10.045433+0000","last_peered":"2024-09-13T18:15:10.045433+0000","last_clean":"2024-09-13T18:15:10.045433+0000","last_became_active":"2024-09-13T18:15:05.576056+0000","last_became_peered":"2024-09-13T18:15:05.576056+0000","last_unstale":"2024-09-13T18:15:10.045433+0000","last_undegraded":"2024-09-13T18:15:10.045433+0000","last_fullsized":"2024-09-13T18:15:10.045433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:25.419342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008269+0000","last_change":"2024-09-13T18:15:06.028288+0000","last_active":"2024-09-13T18:15:07.008269+0000","last_peered":"2024-09-13T18:15:07.008269+0000","last_clean":"2024-09-13T18:15:07.008269+0000","last_became_active":"2024-09-13T18:15:06.028002+0000","last_became_peered":"2024-09-13T18:15:06.028002+0000","last_unstale":"2024-09-13T18:15:07.008269+0000","last_undegraded":"2024-09-13T18:15:07.008269+0000","last_fullsized":"2024-09-13T18:15:07.008269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.258724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927723+0000","last_change":"2024-09-13T18:15:05.567336+0000","last_active":"2024-09-13T18:15:07.927723+0000","last_peered":"2024-09-13T18:15:07.927723+0000","last_clean":"2024-09-13T18:15:07.927723+0000","last_became_active":"2024-09-13T18:15:05.567050+0000","last_became_peered":"2024-09-13T18:15:05.567050+0000","last_unstale":"2024-09-13T18:15:07.927723+0000","last_undegraded":"2024-09-13T18:15:07.927723+0000","last_fullsized":"2024-09-13T18:15:07.927723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:50.016671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.178982+0000","last_change":"2024-09-13T18:15:06.038088+0000","last_active":"2024-09-13T18:15:07.178982+0000","last_peered":"2024-09-13T18:15:07.178982+0000","last_clean":"2024-09-13T18:15:07.178982+0000","last_became_active":"2024-09-13T18:15:06.037686+0000","last_became_peered":"2024-09-13T18:15:06.037686+0000","last_unstale":"2024-09-13T18:15:07.178982+0000","last_undegraded":"2024-09-13T18:15:07.178982+0000","last_fullsized":"2024-09-13T18:15:07.178982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:50.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658832+0000","last_change":"2024-09-13T18:15:05.572920+0000","last_active":"2024-09-13T18:15:07.658832+0000","last_peered":"2024-09-13T18:15:07.658832+0000","last_clean":"2024-09-13T18:15:07.658832+0000","last_became_active":"2024-09-13T18:15:05.572611+0000","last_became_peered":"2024-09-13T18:15:05.572611+0000","last_unstale":"2024-09-13T18:15:07.658832+0000","last_undegraded":"2024-09-13T18:15:07.658832+0000","last_fullsized":"2024-09-13T18:15:07.658832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:35.017695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658670+0000","last_change":"2024-09-13T18:15:06.035681+0000","last_active":"2024-09-13T18:15:07.658670+0000","last_peered":"2024-09-13T18:15:07.658670+0000","last_clean":"2024-09-13T18:15:07.658670+0000","last_became_active":"2024-09-13T18:15:06.035353+0000","last_became_peered":"2024-09-13T18:15:06.035353+0000","last_unstale":"2024-09-13T18:15:07.658670+0000","last_undegraded":"2024-09-13T18:15:07.658670+0000","last_fullsized":"2024-09-13T18:15:07.658670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:09.781692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.055946+0000","last_change":"2024-09-13T18:15:05.578107+0000","last_active":"2024-09-13T18:15:11.055946+0000","last_peered":"2024-09-13T18:15:11.055946+0000","last_clean":"2024-09-13T18:15:11.055946+0000","last_became_active":"2024-09-13T18:15:05.577777+0000","last_became_peered":"2024-09-13T18:15:05.577777+0000","last_unstale":"2024-09-13T18:15:11.055946+0000","last_undegraded":"2024-09-13T18:15:11.055946+0000","last_fullsized":"2024-09-13T18:15:11.055946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:37.573332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.037469+0000","last_change":"2024-09-13T18:15:06.034893+0000","last_active":"2024-09-13T18:15:06.037469+0000","last_peered":"2024-09-13T18:15:06.037469+0000","last_clean":"2024-09-13T18:15:06.037469+0000","last_became_active":"2024-09-13T18:15:06.034421+0000","last_became_peered":"2024-09-13T18:15:06.034421+0000","last_unstale":"2024-09-13T18:15:06.037469+0000","last_undegraded":"2024-09-13T18:15:06.037469+0000","last_fullsized":"2024-09-13T18:15:06.037469+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:23.614971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658704+0000","last_change":"2024-09-13T18:15:05.561912+0000","last_active":"2024-09-13T18:15:07.658704+0000","last_peered":"2024-09-13T18:15:07.658704+0000","last_clean":"2024-09-13T18:15:07.658704+0000","last_became_active":"2024-09-13T18:15:05.561573+0000","last_became_peered":"2024-09-13T18:15:05.561573+0000","last_unstale":"2024-09-13T18:15:07.658704+0000","last_undegraded":"2024-09-13T18:15:07.658704+0000","last_fullsized":"2024-09-13T18:15:07.658704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:06.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008892+0000","last_change":"2024-09-13T18:15:06.023273+0000","last_active":"2024-09-13T18:15:07.008892+0000","last_peered":"2024-09-13T18:15:07.008892+0000","last_clean":"2024-09-13T18:15:07.008892+0000","last_became_active":"2024-09-13T18:15:06.022980+0000","last_became_peered":"2024-09-13T18:15:06.022980+0000","last_unstale":"2024-09-13T18:15:07.008892+0000","last_undegraded":"2024-09-13T18:15:07.008892+0000","last_fullsized":"2024-09-13T18:15:07.008892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:40.966317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.038378+0000","last_change":"2024-09-13T18:15:05.568210+0000","last_active":"2024-09-13T18:15:09.038378+0000","last_peered":"2024-09-13T18:15:09.038378+0000","last_clean":"2024-09-13T18:15:09.038378+0000","last_became_active":"2024-09-13T18:15:05.567881+0000","last_became_peered":"2024-09-13T18:15:05.567881+0000","last_unstale":"2024-09-13T18:15:09.038378+0000","last_undegraded":"2024-09-13T18:15:09.038378+0000","last_fullsized":"2024-09-13T18:15:09.038378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.808041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060113+0000","last_change":"2024-09-13T18:15:06.038795+0000","last_active":"2024-09-13T18:15:06.060113+0000","last_peered":"2024-09-13T18:15:06.060113+0000","last_clean":"2024-09-13T18:15:06.060113+0000","last_became_active":"2024-09-13T18:15:06.038511+0000","last_became_peered":"2024-09-13T18:15:06.038511+0000","last_unstale":"2024-09-13T18:15:06.060113+0000","last_undegraded":"2024-09-13T18:15:06.060113+0000","last_fullsized":"2024-09-13T18:15:06.060113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:07.584249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658289+0000","last_change":"2024-09-13T18:15:05.574322+0000","last_active":"2024-09-13T18:15:07.658289+0000","last_peered":"2024-09-13T18:15:07.658289+0000","last_clean":"2024-09-13T18:15:07.658289+0000","last_became_active":"2024-09-13T18:15:05.573958+0000","last_became_peered":"2024-09-13T18:15:05.573958+0000","last_unstale":"2024-09-13T18:15:07.658289+0000","last_undegraded":"2024-09-13T18:15:07.658289+0000","last_fullsized":"2024-09-13T18:15:07.658289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:46.878632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842013+0000","last_change":"2024-09-13T18:15:06.022444+0000","last_active":"2024-09-13T18:15:06.842013+0000","last_peered":"2024-09-13T18:15:06.842013+0000","last_clean":"2024-09-13T18:15:06.842013+0000","last_became_active":"2024-09-13T18:15:06.022134+0000","last_became_peered":"2024-09-13T18:15:06.022134+0000","last_unstale":"2024-09-13T18:15:06.842013+0000","last_undegraded":"2024-09-13T18:15:06.842013+0000","last_fullsized":"2024-09-13T18:15:06.842013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:36.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008389+0000","last_change":"2024-09-13T18:15:05.559112+0000","last_active":"2024-09-13T18:15:07.008389+0000","last_peered":"2024-09-13T18:15:07.008389+0000","last_clean":"2024-09-13T18:15:07.008389+0000","last_became_active":"2024-09-13T18:15:05.558757+0000","last_became_peered":"2024-09-13T18:15:05.558757+0000","last_unstale":"2024-09-13T18:15:07.008389+0000","last_undegraded":"2024-09-13T18:15:07.008389+0000","last_fullsized":"2024-09-13T18:15:07.008389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:57.691324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077952+0000","last_change":"2024-09-13T18:15:06.032621+0000","last_active":"2024-09-13T18:15:06.077952+0000","last_peered":"2024-09-13T18:15:06.077952+0000","last_clean":"2024-09-13T18:15:06.077952+0000","last_became_active":"2024-09-13T18:15:06.032321+0000","last_became_peered":"2024-09-13T18:15:06.032321+0000","last_unstale":"2024-09-13T18:15:06.077952+0000","last_undegraded":"2024-09-13T18:15:06.077952+0000","last_fullsized":"2024-09-13T18:15:06.077952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:59.695094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.007441+0000","last_change":"2024-09-13T18:15:05.571633+0000","last_active":"2024-09-13T18:15:06.007441+0000","last_peered":"2024-09-13T18:15:06.007441+0000","last_clean":"2024-09-13T18:15:06.007441+0000","last_became_active":"2024-09-13T18:15:05.571292+0000","last_became_peered":"2024-09-13T18:15:05.571292+0000","last_unstale":"2024-09-13T18:15:06.007441+0000","last_undegraded":"2024-09-13T18:15:06.007441+0000","last_fullsized":"2024-09-13T18:15:06.007441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.452906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008666+0000","last_change":"2024-09-13T18:15:06.045725+0000","last_active":"2024-09-13T18:15:07.008666+0000","last_peered":"2024-09-13T18:15:07.008666+0000","last_clean":"2024-09-13T18:15:07.008666+0000","last_became_active":"2024-09-13T18:15:06.045401+0000","last_became_peered":"2024-09-13T18:15:06.045401+0000","last_unstale":"2024-09-13T18:15:07.008666+0000","last_undegraded":"2024-09-13T18:15:07.008666+0000","last_fullsized":"2024-09-13T18:15:07.008666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:30.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.037165+0000","last_change":"2024-09-13T18:15:05.567295+0000","last_active":"2024-09-13T18:15:09.037165+0000","last_peered":"2024-09-13T18:15:09.037165+0000","last_clean":"2024-09-13T18:15:09.037165+0000","last_became_active":"2024-09-13T18:15:05.566992+0000","last_became_peered":"2024-09-13T18:15:05.566992+0000","last_unstale":"2024-09-13T18:15:09.037165+0000","last_undegraded":"2024-09-13T18:15:09.037165+0000","last_fullsized":"2024-09-13T18:15:09.037165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:27.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927588+0000","last_change":"2024-09-13T18:15:06.036750+0000","last_active":"2024-09-13T18:15:07.927588+0000","last_peered":"2024-09-13T18:15:07.927588+0000","last_clean":"2024-09-13T18:15:07.927588+0000","last_became_active":"2024-09-13T18:15:06.036424+0000","last_became_peered":"2024-09-13T18:15:06.036424+0000","last_unstale":"2024-09-13T18:15:07.927588+0000","last_undegraded":"2024-09-13T18:15:07.927588+0000","last_fullsized":"2024-09-13T18:15:07.927588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:49.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008526+0000","last_change":"2024-09-13T18:15:06.027697+0000","last_active":"2024-09-13T18:15:07.008526+0000","last_peered":"2024-09-13T18:15:07.008526+0000","last_clean":"2024-09-13T18:15:07.008526+0000","last_became_active":"2024-09-13T18:15:06.027402+0000","last_became_peered":"2024-09-13T18:15:06.027402+0000","last_unstale":"2024-09-13T18:15:07.008526+0000","last_undegraded":"2024-09-13T18:15:07.008526+0000","last_fullsized":"2024-09-13T18:15:07.008526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:45.004828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842103+0000","last_change":"2024-09-13T18:15:05.562459+0000","last_active":"2024-09-13T18:15:06.842103+0000","last_peered":"2024-09-13T18:15:06.842103+0000","last_clean":"2024-09-13T18:15:06.842103+0000","last_became_active":"2024-09-13T18:15:05.562107+0000","last_became_peered":"2024-09-13T18:15:05.562107+0000","last_unstale":"2024-09-13T18:15:06.842103+0000","last_undegraded":"2024-09-13T18:15:06.842103+0000","last_fullsized":"2024-09-13T18:15:06.842103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:39.740829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658527+0000","last_change":"2024-09-13T18:15:06.027566+0000","last_active":"2024-09-13T18:15:07.658527+0000","last_peered":"2024-09-13T18:15:07.658527+0000","last_clean":"2024-09-13T18:15:07.658527+0000","last_became_active":"2024-09-13T18:15:06.027271+0000","last_became_peered":"2024-09-13T18:15:06.027271+0000","last_unstale":"2024-09-13T18:15:07.658527+0000","last_undegraded":"2024-09-13T18:15:07.658527+0000","last_fullsized":"2024-09-13T18:15:07.658527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:37.929848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.054130+0000","last_change":"2024-09-13T18:15:05.567206+0000","last_active":"2024-09-13T18:15:11.054130+0000","last_peered":"2024-09-13T18:15:11.054130+0000","last_clean":"2024-09-13T18:15:11.054130+0000","last_became_active":"2024-09-13T18:15:05.566905+0000","last_became_peered":"2024-09-13T18:15:05.566905+0000","last_unstale":"2024-09-13T18:15:11.054130+0000","last_undegraded":"2024-09-13T18:15:11.054130+0000","last_fullsized":"2024-09-13T18:15:11.054130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:56.498418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060122+0000","last_change":"2024-09-13T18:15:06.041388+0000","last_active":"2024-09-13T18:15:06.060122+0000","last_peered":"2024-09-13T18:15:06.060122+0000","last_clean":"2024-09-13T18:15:06.060122+0000","last_became_active":"2024-09-13T18:15:06.041102+0000","last_became_peered":"2024-09-13T18:15:06.041102+0000","last_unstale":"2024-09-13T18:15:06.060122+0000","last_undegraded":"2024-09-13T18:15:06.060122+0000","last_fullsized":"2024-09-13T18:15:06.060122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:13.919598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008877+0000","last_change":"2024-09-13T18:15:05.573970+0000","last_active":"2024-09-13T18:15:07.008877+0000","last_peered":"2024-09-13T18:15:07.008877+0000","last_clean":"2024-09-13T18:15:07.008877+0000","last_became_active":"2024-09-13T18:15:05.571778+0000","last_became_peered":"2024-09-13T18:15:05.571778+0000","last_unstale":"2024-09-13T18:15:07.008877+0000","last_undegraded":"2024-09-13T18:15:07.008877+0000","last_fullsized":"2024-09-13T18:15:07.008877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:52.799646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008775+0000","last_change":"2024-09-13T18:15:06.025563+0000","last_active":"2024-09-13T18:15:07.008775+0000","last_peered":"2024-09-13T18:15:07.008775+0000","last_clean":"2024-09-13T18:15:07.008775+0000","last_became_active":"2024-09-13T18:15:06.025257+0000","last_became_peered":"2024-09-13T18:15:06.025257+0000","last_unstale":"2024-09-13T18:15:07.008775+0000","last_undegraded":"2024-09-13T18:15:07.008775+0000","last_fullsized":"2024-09-13T18:15:07.008775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:52.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658754+0000","last_change":"2024-09-13T18:15:05.562126+0000","last_active":"2024-09-13T18:15:07.658754+0000","last_peered":"2024-09-13T18:15:07.658754+0000","last_clean":"2024-09-13T18:15:07.658754+0000","last_became_active":"2024-09-13T18:15:05.561646+0000","last_became_peered":"2024-09-13T18:15:05.561646+0000","last_unstale":"2024-09-13T18:15:07.658754+0000","last_undegraded":"2024-09-13T18:15:07.658754+0000","last_fullsized":"2024-09-13T18:15:07.658754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23206,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":33394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":933888,"data_stored":442504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":10,"up_from":73,"seq":313532612625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1054773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.498},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.434}]},{"osd":2,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.622},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70299999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53400000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.64700000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776150,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":433372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.442},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.624},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.61199999999999999}]},{"osd":8,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.69399999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.71499999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":442098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.38700000000000001,"15min":0.39500000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45200000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52600000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66000000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70199999999999996,"5min":0.747,"15min":0.747},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.371},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.47199999999999998,"15min":0.48399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60899999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61399999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83999999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.624}]},{"osd":7,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48799999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68500000000000005}]},{"osd":10,"last update":"Fri Sep 13 18:14:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":7,"up_from":52,"seq":223338299423,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1519616,"data_stored":1032310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73399999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.443}]},{"osd":1,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35199999999999998,"15min":0.34899999999999998},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28000000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.377},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.249}]},{"osd":5,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88900000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.45000000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.40799999999999997}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.627},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46600000000000003}]},{"osd":9,"last update":"Fri Sep 13 18:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.443},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56799999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:14:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":6,"up_from":47,"seq":201863462949,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36108,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709044,"statfs":{"total":95995035648,"available":95958061056,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82099999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86899999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94999999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.044,"15min":1.044},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2130000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":1.1799999999999999,"5min":1.397,"15min":1.397},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.51000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.53300000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93899999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.204,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.505}]},{"osd":5,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.59999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97999999999999998,"5min":1.22,"15min":1.22},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.52100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1459999999999999,"5min":1.486,"15min":1.486},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:14:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.875},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.48899999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56899999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":0.92300000000000004,"15min":0.83399999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":11.670999999999999,"5min":11.670999999999999,"15min":11.670999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88200000000000001,"15min":0.872},"min":{"1min":0.69599999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.96999999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64300000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.01}]}]},{"osd":5,"up_from":39,"seq":167503724587,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32612,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712540,"statfs":{"total":95995035648,"available":95961640960,"internally_reserved":0,"allocated":1523712,"data_stored":1031629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81200000000000006,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.505},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":1.175,"15min":1.175},"last":0.442}]},{"osd":1,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.313}]},{"osd":3,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.38},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.35499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81299999999999994,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54700000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.873},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.47599999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46400000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.56699999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52400000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":933888,"data_stored":441956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.48999999999999999},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48299999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.39300000000000002},"min":{"1min":0.23400000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.54800000000000004},"min":{"1min":0.46899999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.442,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:14:19 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73099999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.46999999999999997},"min":{"1min":0.32000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39800000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:15:05 2024","interfaces":[{"interface":"back","average":{"1min":1.9790000000000001,"5min":0.871,"15min":0.68700000000000006},"min":{"1min":0.56499999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":18.643000000000001,"5min":18.643000000000001,"15min":18.643000000000001},"last":0.504},{"interface":"front","average":{"1min":2.044,"5min":0.90100000000000002,"15min":0.71099999999999997},"min":{"1min":0.60499999999999998,"5min":0.502,"15min":0.502},"max":{"1min":18.629999999999999,"5min":18.629999999999999,"15min":18.629999999999999},"last":0.75600000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68400000000000005}]},{"osd":10,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149746,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36116,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709036,"statfs":{"total":95995035648,"available":95958052864,"internally_reserved":0,"allocated":925696,"data_stored":441133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.34000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81299999999999994,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.90200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.65800000000000003,"15min":0.62},"min":{"1min":0.61399999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.52800000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.80800000000000005,"5min":1.012,"15min":1.012},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.67500000000000004},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90000000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84499999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":0.999,"15min":0.999},"last":0.93500000000000005}]},{"osd":8,"last update":"Fri Sep 13 18:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.88},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.1499999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.97399999999999998}]},{"osd":10,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.0740000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":2,"up_from":18,"seq":77309411385,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":443532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.56299999999999994},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":1.097,"15min":1.097},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.159,"15min":1.159},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80700000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.38700000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72499999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.435,"15min":0.41499999999999998},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68000000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:14:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71999999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.64900000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.79400000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.69399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":442924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53800000000000003,"15min":0.51500000000000001},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.495},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0389999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.311,"5min":0.252,"15min":0.252},"max":{"1min":0.65100000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.58499999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39100000000000001},"min":{"1min":0.29399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.45300000000000001,"15min":0.439},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.52600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.62},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.29499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.51700000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65500000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.65200000000000002,"15min":0.64400000000000002},"min":{"1min":0.503,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.95799999999999996}]},{"osd":9,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.94899999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.57299999999999995,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0109999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.626}]},{"osd":2,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60899999999999999,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.58199999999999996,"15min":0.54600000000000004},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.46700000000000003,"15min":0.442},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.49399999999999999,"15min":0.45400000000000001},"min":{"1min":0.38500000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.55800000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.629,"15min":0.60799999999999998},"min":{"1min":0.53500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.046},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:14:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.755,"15min":0.751},"min":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69699999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0569999999999999,"5min":1.153,"15min":1.153},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.84399999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.083,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0049999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68700000000000006}]},{"osd":10,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.083}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:15:14.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:15:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:14 smithi116 ceph-mon[35109]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:14 smithi116 ceph-mon[35109]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T18:15:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:14 smithi116 ceph-mon[35109]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:14 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/270941950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:14 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/596293592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:14 smithi067 ceph-mon[35103]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:14 smithi067 ceph-mon[35103]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T18:15:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:14 smithi067 ceph-mon[35103]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:15:14.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:14 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/270941950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:15:14.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:14 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/596293592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 -- 172.21.15.7:0/1599660082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27241039b0 msgr2=0x7f272410a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 --2- 172.21.15.7:0/1599660082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27241039b0 0x7f272410a240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f271c009ca0 tx=0x7f271c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 -- 172.21.15.7:0/1599660082 shutdown_connections 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 --2- 172.21.15.7:0/1599660082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27241039b0 0x7f272410a240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 --2- 172.21.15.7:0/1599660082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2724102ff0 0x7f2724103470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 --2- 172.21.15.7:0/1599660082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2724101e00 0x7f2724102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 -- 172.21.15.7:0/1599660082 >> 172.21.15.7:0/1599660082 conn(0x7f27240fd580 msgr2=0x7f27240ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 -- 172.21.15.7:0/1599660082 shutdown_connections 2024-09-13T18:15:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.524+0000 7f2729c00640 1 -- 172.21.15.7:0/1599660082 wait complete. 2024-09-13T18:15:14.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 Processor -- start 2024-09-13T18:15:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 -- start start 2024-09-13T18:15:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2724101e00 0x7f2724197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2724102ff0 0x7f2724198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27241039b0 0x7f272419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272419f8c0 con 0x7f2724101e00 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272419fa30 con 0x7f27241039b0 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272419fbf0 con 0x7f2724102ff0 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2723e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2724101e00 0x7f2724197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2723e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2724101e00 0x7f2724197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45834/0 (socket says 172.21.15.7:45834) 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2723e00640 1 -- 172.21.15.7:0/2634796565 learned_addr learned my addr 172.21.15.7:0/2634796565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.525+0000 7f2729200640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27241039b0 0x7f272419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f271be00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2724102ff0 0x7f2724198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2723e00640 1 -- 172.21.15.7:0/2634796565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2724102ff0 msgr2=0x7f2724198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2723e00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2724102ff0 0x7f2724198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2723e00640 1 -- 172.21.15.7:0/2634796565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27241039b0 msgr2=0x7f272419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2723e00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27241039b0 0x7f272419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2723e00640 1 -- 172.21.15.7:0/2634796565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009490 con 0x7f2724101e00 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2723e00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2724101e00 0x7f2724197dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f271400e9c0 tx=0x7f271400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2721600640 1 -- 172.21.15.7:0/2634796565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714009700 con 0x7f2724101e00 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c009900 con 0x7f2724101e00 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2721600640 1 -- 172.21.15.7:0/2634796565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27140044e0 con 0x7f2724101e00 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.526+0000 7f2721600640 1 -- 172.21.15.7:0/2634796565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714010430 con 0x7f2724101e00 2024-09-13T18:15:14.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.527+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27241a01a0 con 0x7f2724101e00 2024-09-13T18:15:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.528+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27241091e0 con 0x7f2724101e00 2024-09-13T18:15:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.529+0000 7f2721600640 1 -- 172.21.15.7:0/2634796565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f2714003f60 con 0x7f2724101e00 2024-09-13T18:15:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.531+0000 7f2721600640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27080a1120 0x7f27080a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.531+0000 7f2721600640 1 -- 172.21.15.7:0/2634796565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2714014070 con 0x7f2724101e00 2024-09-13T18:15:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.531+0000 7f271be00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27080a1120 0x7f27080a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.532+0000 7f271be00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27080a1120 0x7f27080a35e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27241992e0 tx=0x7f270c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:14.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.535+0000 7f2721600640 1 -- 172.21.15.7:0/2634796565 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2714096540 con 0x7f2724101e00 2024-09-13T18:15:14.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.711+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f272402c450 con 0x7f27080a1120 2024-09-13T18:15:14.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.720+0000 7f2721600640 1 -- 172.21.15.7:0/2634796565 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336297 (secure 0 0 0) 0x7f272402c450 con 0x7f27080a1120 2024-09-13T18:15:14.727 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:14.729 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27080a1120 msgr2=0x7f27080a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27080a1120 0x7f27080a35e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27241992e0 tx=0x7f270c005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2724101e00 msgr2=0x7f2724197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2724101e00 0x7f2724197dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f271400e9c0 tx=0x7f271400ee80 comp rx=0 tx=0).stop 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 shutdown_connections 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27080a1120 0x7f27080a35e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27241039b0 0x7f272419f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2724102ff0 0x7f2724198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 --2- 172.21.15.7:0/2634796565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2724101e00 0x7f2724197dd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:14.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 >> 172.21.15.7:0/2634796565 conn(0x7f27240fd580 msgr2=0x7f27241063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:14.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.725+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 shutdown_connections 2024-09-13T18:15:14.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:14.726+0000 7f2729c00640 1 -- 172.21.15.7:0/2634796565 wait complete. 2024-09-13T18:15:14.744 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-13T18:15:14.508878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616748,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":359,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365748,"kb_used_data":12884,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124576076,"statfs":{"total":1151940427776,"available":1151565901824,"internally_reserved":0,"allocated":13193216,"data_stored":7127172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":361215301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26380,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":178,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.503719"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077990+0000","last_change":"2024-09-13T18:15:06.044297+0000","last_active":"2024-09-13T18:15:06.077990+0000","last_peered":"2024-09-13T18:15:06.077990+0000","last_clean":"2024-09-13T18:15:06.077990+0000","last_became_active":"2024-09-13T18:15:06.043984+0000","last_became_peered":"2024-09-13T18:15:06.043984+0000","last_unstale":"2024-09-13T18:15:06.077990+0000","last_undegraded":"2024-09-13T18:15:06.077990+0000","last_fullsized":"2024-09-13T18:15:06.077990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:39.469599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060105+0000","last_change":"2024-09-13T18:15:06.038427+0000","last_active":"2024-09-13T18:15:06.060105+0000","last_peered":"2024-09-13T18:15:06.060105+0000","last_clean":"2024-09-13T18:15:06.060105+0000","last_became_active":"2024-09-13T18:15:06.038112+0000","last_became_peered":"2024-09-13T18:15:06.038112+0000","last_unstale":"2024-09-13T18:15:06.060105+0000","last_undegraded":"2024-09-13T18:15:06.060105+0000","last_fullsized":"2024-09-13T18:15:06.060105+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:40.892099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060096+0000","last_change":"2024-09-13T18:15:06.035197+0000","last_active":"2024-09-13T18:15:06.060096+0000","last_peered":"2024-09-13T18:15:06.060096+0000","last_clean":"2024-09-13T18:15:06.060096+0000","last_became_active":"2024-09-13T18:15:06.029918+0000","last_became_peered":"2024-09-13T18:15:06.029918+0000","last_unstale":"2024-09-13T18:15:06.060096+0000","last_undegraded":"2024-09-13T18:15:06.060096+0000","last_fullsized":"2024-09-13T18:15:06.060096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:46.482020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.031948+0000","last_change":"2024-09-13T18:15:06.030482+0000","last_active":"2024-09-13T18:15:06.031948+0000","last_peered":"2024-09-13T18:15:06.031948+0000","last_clean":"2024-09-13T18:15:06.031948+0000","last_became_active":"2024-09-13T18:15:06.029980+0000","last_became_peered":"2024-09-13T18:15:06.029980+0000","last_unstale":"2024-09-13T18:15:06.031948+0000","last_undegraded":"2024-09-13T18:15:06.031948+0000","last_fullsized":"2024-09-13T18:15:06.031948+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:04.488837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842065+0000","last_change":"2024-09-13T18:15:06.027624+0000","last_active":"2024-09-13T18:15:06.842065+0000","last_peered":"2024-09-13T18:15:06.842065+0000","last_clean":"2024-09-13T18:15:06.842065+0000","last_became_active":"2024-09-13T18:15:06.027353+0000","last_became_peered":"2024-09-13T18:15:06.027353+0000","last_unstale":"2024-09-13T18:15:06.842065+0000","last_undegraded":"2024-09-13T18:15:06.842065+0000","last_fullsized":"2024-09-13T18:15:06.842065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:30.159234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.178930+0000","last_change":"2024-09-13T18:15:06.026446+0000","last_active":"2024-09-13T18:15:07.178930+0000","last_peered":"2024-09-13T18:15:07.178930+0000","last_clean":"2024-09-13T18:15:07.178930+0000","last_became_active":"2024-09-13T18:15:06.026115+0000","last_became_peered":"2024-09-13T18:15:06.026115+0000","last_unstale":"2024-09-13T18:15:07.178930+0000","last_undegraded":"2024-09-13T18:15:07.178930+0000","last_fullsized":"2024-09-13T18:15:07.178930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:26.449382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927393+0000","last_change":"2024-09-13T18:15:06.019147+0000","last_active":"2024-09-13T18:15:07.927393+0000","last_peered":"2024-09-13T18:15:07.927393+0000","last_clean":"2024-09-13T18:15:07.927393+0000","last_became_active":"2024-09-13T18:15:06.018239+0000","last_became_peered":"2024-09-13T18:15:06.018239+0000","last_unstale":"2024-09-13T18:15:07.927393+0000","last_undegraded":"2024-09-13T18:15:07.927393+0000","last_fullsized":"2024-09-13T18:15:07.927393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:31.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008289+0000","last_change":"2024-09-13T18:15:06.029615+0000","last_active":"2024-09-13T18:15:07.008289+0000","last_peered":"2024-09-13T18:15:07.008289+0000","last_clean":"2024-09-13T18:15:07.008289+0000","last_became_active":"2024-09-13T18:15:06.029351+0000","last_became_peered":"2024-09-13T18:15:06.029351+0000","last_unstale":"2024-09-13T18:15:07.008289+0000","last_undegraded":"2024-09-13T18:15:07.008289+0000","last_fullsized":"2024-09-13T18:15:07.008289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:36.533097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.659071+0000","last_change":"2024-09-13T18:15:06.022623+0000","last_active":"2024-09-13T18:15:07.659071+0000","last_peered":"2024-09-13T18:15:07.659071+0000","last_clean":"2024-09-13T18:15:07.659071+0000","last_became_active":"2024-09-13T18:15:06.022338+0000","last_became_peered":"2024-09-13T18:15:06.022338+0000","last_unstale":"2024-09-13T18:15:07.659071+0000","last_undegraded":"2024-09-13T18:15:07.659071+0000","last_fullsized":"2024-09-13T18:15:07.659071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:24.658524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.179041+0000","last_change":"2024-09-13T18:15:06.025226+0000","last_active":"2024-09-13T18:15:07.179041+0000","last_peered":"2024-09-13T18:15:07.179041+0000","last_clean":"2024-09-13T18:15:07.179041+0000","last_became_active":"2024-09-13T18:15:06.024910+0000","last_became_peered":"2024-09-13T18:15:06.024910+0000","last_unstale":"2024-09-13T18:15:07.179041+0000","last_undegraded":"2024-09-13T18:15:07.179041+0000","last_fullsized":"2024-09-13T18:15:07.179041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:43.548175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927826+0000","last_change":"2024-09-13T18:15:06.028140+0000","last_active":"2024-09-13T18:15:07.927826+0000","last_peered":"2024-09-13T18:15:07.927826+0000","last_clean":"2024-09-13T18:15:07.927826+0000","last_became_active":"2024-09-13T18:15:06.027774+0000","last_became_peered":"2024-09-13T18:15:06.027774+0000","last_unstale":"2024-09-13T18:15:07.927826+0000","last_undegraded":"2024-09-13T18:15:07.927826+0000","last_fullsized":"2024-09-13T18:15:07.927826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:34.454084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.030961+0000","last_change":"2024-09-13T18:15:06.030264+0000","last_active":"2024-09-13T18:15:06.030961+0000","last_peered":"2024-09-13T18:15:06.030961+0000","last_clean":"2024-09-13T18:15:06.030961+0000","last_became_active":"2024-09-13T18:15:06.029571+0000","last_became_peered":"2024-09-13T18:15:06.029571+0000","last_unstale":"2024-09-13T18:15:06.030961+0000","last_undegraded":"2024-09-13T18:15:06.030961+0000","last_fullsized":"2024-09-13T18:15:06.030961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:15.545277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.034205+0000","last_change":"2024-09-13T18:15:06.029189+0000","last_active":"2024-09-13T18:15:06.034205+0000","last_peered":"2024-09-13T18:15:06.034205+0000","last_clean":"2024-09-13T18:15:06.034205+0000","last_became_active":"2024-09-13T18:15:06.028834+0000","last_became_peered":"2024-09-13T18:15:06.028834+0000","last_unstale":"2024-09-13T18:15:06.034205+0000","last_undegraded":"2024-09-13T18:15:06.034205+0000","last_fullsized":"2024-09-13T18:15:06.034205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:21.744826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060077+0000","last_change":"2024-09-13T18:15:06.044048+0000","last_active":"2024-09-13T18:15:06.060077+0000","last_peered":"2024-09-13T18:15:06.060077+0000","last_clean":"2024-09-13T18:15:06.060077+0000","last_became_active":"2024-09-13T18:15:06.043292+0000","last_became_peered":"2024-09-13T18:15:06.043292+0000","last_unstale":"2024-09-13T18:15:06.060077+0000","last_undegraded":"2024-09-13T18:15:06.060077+0000","last_fullsized":"2024-09-13T18:15:06.060077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:41.788308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060062+0000","last_change":"2024-09-13T18:15:06.033817+0000","last_active":"2024-09-13T18:15:06.060062+0000","last_peered":"2024-09-13T18:15:06.060062+0000","last_clean":"2024-09-13T18:15:06.060062+0000","last_became_active":"2024-09-13T18:15:06.033507+0000","last_became_peered":"2024-09-13T18:15:06.033507+0000","last_unstale":"2024-09-13T18:15:06.060062+0000","last_undegraded":"2024-09-13T18:15:06.060062+0000","last_fullsized":"2024-09-13T18:15:06.060062+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:15.197681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658610+0000","last_change":"2024-09-13T18:15:06.032811+0000","last_active":"2024-09-13T18:15:07.658610+0000","last_peered":"2024-09-13T18:15:07.658610+0000","last_clean":"2024-09-13T18:15:07.658610+0000","last_became_active":"2024-09-13T18:15:06.032444+0000","last_became_peered":"2024-09-13T18:15:06.032444+0000","last_unstale":"2024-09-13T18:15:07.658610+0000","last_undegraded":"2024-09-13T18:15:07.658610+0000","last_fullsized":"2024-09-13T18:15:07.658610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:37.214417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077996+0000","last_change":"2024-09-13T18:15:06.040484+0000","last_active":"2024-09-13T18:15:06.077996+0000","last_peered":"2024-09-13T18:15:06.077996+0000","last_clean":"2024-09-13T18:15:06.077996+0000","last_became_active":"2024-09-13T18:15:06.040235+0000","last_became_peered":"2024-09-13T18:15:06.040235+0000","last_unstale":"2024-09-13T18:15:06.077996+0000","last_undegraded":"2024-09-13T18:15:06.077996+0000","last_fullsized":"2024-09-13T18:15:06.077996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:12.266079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658604+0000","last_change":"2024-09-13T18:15:06.019137+0000","last_active":"2024-09-13T18:15:07.658604+0000","last_peered":"2024-09-13T18:15:07.658604+0000","last_clean":"2024-09-13T18:15:07.658604+0000","last_became_active":"2024-09-13T18:15:06.018554+0000","last_became_peered":"2024-09-13T18:15:06.018554+0000","last_unstale":"2024-09-13T18:15:07.658604+0000","last_undegraded":"2024-09-13T18:15:07.658604+0000","last_fullsized":"2024-09-13T18:15:07.658604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:14.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157418+0000","last_change":"2024-09-13T18:15:06.026643+0000","last_active":"2024-09-13T18:15:07.157418+0000","last_peered":"2024-09-13T18:15:07.157418+0000","last_clean":"2024-09-13T18:15:07.157418+0000","last_became_active":"2024-09-13T18:15:06.026024+0000","last_became_peered":"2024-09-13T18:15:06.026024+0000","last_unstale":"2024-09-13T18:15:07.157418+0000","last_undegraded":"2024-09-13T18:15:07.157418+0000","last_fullsized":"2024-09-13T18:15:07.157418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:16.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077961+0000","last_change":"2024-09-13T18:15:06.025101+0000","last_active":"2024-09-13T18:15:06.077961+0000","last_peered":"2024-09-13T18:15:06.077961+0000","last_clean":"2024-09-13T18:15:06.077961+0000","last_became_active":"2024-09-13T18:15:06.024810+0000","last_became_peered":"2024-09-13T18:15:06.024810+0000","last_unstale":"2024-09-13T18:15:06.077961+0000","last_undegraded":"2024-09-13T18:15:06.077961+0000","last_fullsized":"2024-09-13T18:15:06.077961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.347722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.047774+0000","last_change":"2024-09-13T18:15:06.044817+0000","last_active":"2024-09-13T18:15:06.047774+0000","last_peered":"2024-09-13T18:15:06.047774+0000","last_clean":"2024-09-13T18:15:06.047774+0000","last_became_active":"2024-09-13T18:15:06.044485+0000","last_became_peered":"2024-09-13T18:15:06.044485+0000","last_unstale":"2024-09-13T18:15:06.047774+0000","last_undegraded":"2024-09-13T18:15:06.047774+0000","last_fullsized":"2024-09-13T18:15:06.047774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:25.622237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658845+0000","last_change":"2024-09-13T18:15:06.030149+0000","last_active":"2024-09-13T18:15:07.658845+0000","last_peered":"2024-09-13T18:15:07.658845+0000","last_clean":"2024-09-13T18:15:07.658845+0000","last_became_active":"2024-09-13T18:15:06.029830+0000","last_became_peered":"2024-09-13T18:15:06.029830+0000","last_unstale":"2024-09-13T18:15:07.658845+0000","last_undegraded":"2024-09-13T18:15:07.658845+0000","last_fullsized":"2024-09-13T18:15:07.658845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:37.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008406+0000","last_change":"2024-09-13T18:15:06.032485+0000","last_active":"2024-09-13T18:15:07.008406+0000","last_peered":"2024-09-13T18:15:07.008406+0000","last_clean":"2024-09-13T18:15:07.008406+0000","last_became_active":"2024-09-13T18:15:06.032041+0000","last_became_peered":"2024-09-13T18:15:06.032041+0000","last_unstale":"2024-09-13T18:15:07.008406+0000","last_undegraded":"2024-09-13T18:15:07.008406+0000","last_fullsized":"2024-09-13T18:15:07.008406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:09.793771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008298+0000","last_change":"2024-09-13T18:15:06.020133+0000","last_active":"2024-09-13T18:15:07.008298+0000","last_peered":"2024-09-13T18:15:07.008298+0000","last_clean":"2024-09-13T18:15:07.008298+0000","last_became_active":"2024-09-13T18:15:06.019829+0000","last_became_peered":"2024-09-13T18:15:06.019829+0000","last_unstale":"2024-09-13T18:15:07.008298+0000","last_undegraded":"2024-09-13T18:15:07.008298+0000","last_fullsized":"2024-09-13T18:15:07.008298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:27.635560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008867+0000","last_change":"2024-09-13T18:15:06.026796+0000","last_active":"2024-09-13T18:15:07.008867+0000","last_peered":"2024-09-13T18:15:07.008867+0000","last_clean":"2024-09-13T18:15:07.008867+0000","last_became_active":"2024-09-13T18:15:06.026449+0000","last_became_peered":"2024-09-13T18:15:06.026449+0000","last_unstale":"2024-09-13T18:15:07.008867+0000","last_undegraded":"2024-09-13T18:15:07.008867+0000","last_fullsized":"2024-09-13T18:15:07.008867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:09.825997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157450+0000","last_change":"2024-09-13T18:15:06.019787+0000","last_active":"2024-09-13T18:15:07.157450+0000","last_peered":"2024-09-13T18:15:07.157450+0000","last_clean":"2024-09-13T18:15:07.157450+0000","last_became_active":"2024-09-13T18:15:06.019514+0000","last_became_peered":"2024-09-13T18:15:06.019514+0000","last_unstale":"2024-09-13T18:15:07.157450+0000","last_undegraded":"2024-09-13T18:15:07.157450+0000","last_fullsized":"2024-09-13T18:15:07.157450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:05.614832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077970+0000","last_change":"2024-09-13T18:15:06.024397+0000","last_active":"2024-09-13T18:15:06.077970+0000","last_peered":"2024-09-13T18:15:06.077970+0000","last_clean":"2024-09-13T18:15:06.077970+0000","last_became_active":"2024-09-13T18:15:06.024089+0000","last_became_peered":"2024-09-13T18:15:06.024089+0000","last_unstale":"2024-09-13T18:15:06.077970+0000","last_undegraded":"2024-09-13T18:15:06.077970+0000","last_fullsized":"2024-09-13T18:15:06.077970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:42.590652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.047786+0000","last_change":"2024-09-13T18:15:06.045070+0000","last_active":"2024-09-13T18:15:06.047786+0000","last_peered":"2024-09-13T18:15:06.047786+0000","last_clean":"2024-09-13T18:15:06.047786+0000","last_became_active":"2024-09-13T18:15:06.044098+0000","last_became_peered":"2024-09-13T18:15:06.044098+0000","last_unstale":"2024-09-13T18:15:06.047786+0000","last_undegraded":"2024-09-13T18:15:06.047786+0000","last_fullsized":"2024-09-13T18:15:06.047786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:53.943354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060087+0000","last_change":"2024-09-13T18:15:06.038938+0000","last_active":"2024-09-13T18:15:06.060087+0000","last_peered":"2024-09-13T18:15:06.060087+0000","last_clean":"2024-09-13T18:15:06.060087+0000","last_became_active":"2024-09-13T18:15:06.038432+0000","last_became_peered":"2024-09-13T18:15:06.038432+0000","last_unstale":"2024-09-13T18:15:06.060087+0000","last_undegraded":"2024-09-13T18:15:06.060087+0000","last_fullsized":"2024-09-13T18:15:06.060087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.339859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157190+0000","last_change":"2024-09-13T18:15:06.044302+0000","last_active":"2024-09-13T18:15:07.157190+0000","last_peered":"2024-09-13T18:15:07.157190+0000","last_clean":"2024-09-13T18:15:07.157190+0000","last_became_active":"2024-09-13T18:15:06.043959+0000","last_became_peered":"2024-09-13T18:15:06.043959+0000","last_unstale":"2024-09-13T18:15:07.157190+0000","last_undegraded":"2024-09-13T18:15:07.157190+0000","last_fullsized":"2024-09-13T18:15:07.157190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:06.271075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.157212+0000","last_change":"2024-09-13T18:15:06.017040+0000","last_active":"2024-09-13T18:15:07.157212+0000","last_peered":"2024-09-13T18:15:07.157212+0000","last_clean":"2024-09-13T18:15:07.157212+0000","last_became_active":"2024-09-13T18:15:06.016710+0000","last_became_peered":"2024-09-13T18:15:06.016710+0000","last_unstale":"2024-09-13T18:15:07.157212+0000","last_undegraded":"2024-09-13T18:15:07.157212+0000","last_fullsized":"2024-09-13T18:15:07.157212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:07.214004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077940+0000","last_change":"2024-09-13T18:15:06.023969+0000","last_active":"2024-09-13T18:15:06.077940+0000","last_peered":"2024-09-13T18:15:06.077940+0000","last_clean":"2024-09-13T18:15:06.077940+0000","last_became_active":"2024-09-13T18:15:06.023641+0000","last_became_peered":"2024-09-13T18:15:06.023641+0000","last_unstale":"2024-09-13T18:15:06.077940+0000","last_undegraded":"2024-09-13T18:15:06.077940+0000","last_fullsized":"2024-09-13T18:15:06.077940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:27.188715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842030+0000","last_change":"2024-09-13T18:15:06.021576+0000","last_active":"2024-09-13T18:15:06.842030+0000","last_peered":"2024-09-13T18:15:06.842030+0000","last_clean":"2024-09-13T18:15:06.842030+0000","last_became_active":"2024-09-13T18:15:06.018911+0000","last_became_peered":"2024-09-13T18:15:06.018911+0000","last_unstale":"2024-09-13T18:15:06.842030+0000","last_undegraded":"2024-09-13T18:15:06.842030+0000","last_fullsized":"2024-09-13T18:15:06.842030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:04.669568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.719356+0000","last_change":"2024-09-13T18:15:05.568259+0000","last_active":"2024-09-13T18:15:12.719356+0000","last_peered":"2024-09-13T18:15:12.719356+0000","last_clean":"2024-09-13T18:15:12.719356+0000","last_became_active":"2024-09-13T18:15:05.567888+0000","last_became_peered":"2024-09-13T18:15:05.567888+0000","last_unstale":"2024-09-13T18:15:12.719356+0000","last_undegraded":"2024-09-13T18:15:12.719356+0000","last_fullsized":"2024-09-13T18:15:12.719356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:50.942167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008328+0000","last_change":"2024-09-13T18:15:06.025868+0000","last_active":"2024-09-13T18:15:07.008328+0000","last_peered":"2024-09-13T18:15:07.008328+0000","last_clean":"2024-09-13T18:15:07.008328+0000","last_became_active":"2024-09-13T18:15:06.025583+0000","last_became_peered":"2024-09-13T18:15:06.025583+0000","last_unstale":"2024-09-13T18:15:07.008328+0000","last_undegraded":"2024-09-13T18:15:07.008328+0000","last_fullsized":"2024-09-13T18:15:07.008328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:15.774579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.055742+0000","last_change":"2024-09-13T18:15:05.570260+0000","last_active":"2024-09-13T18:15:11.055742+0000","last_peered":"2024-09-13T18:15:11.055742+0000","last_clean":"2024-09-13T18:15:11.055742+0000","last_became_active":"2024-09-13T18:15:05.569942+0000","last_became_peered":"2024-09-13T18:15:05.569942+0000","last_unstale":"2024-09-13T18:15:11.055742+0000","last_undegraded":"2024-09-13T18:15:11.055742+0000","last_fullsized":"2024-09-13T18:15:11.055742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:24.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.044485+0000","last_change":"2024-09-13T18:15:05.568010+0000","last_active":"2024-09-13T18:15:10.044485+0000","last_peered":"2024-09-13T18:15:10.044485+0000","last_clean":"2024-09-13T18:15:10.044485+0000","last_became_active":"2024-09-13T18:15:05.567415+0000","last_became_peered":"2024-09-13T18:15:05.567415+0000","last_unstale":"2024-09-13T18:15:10.044485+0000","last_undegraded":"2024-09-13T18:15:10.044485+0000","last_fullsized":"2024-09-13T18:15:10.044485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:26.873148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008717+0000","last_change":"2024-09-13T18:15:06.034747+0000","last_active":"2024-09-13T18:15:07.008717+0000","last_peered":"2024-09-13T18:15:07.008717+0000","last_clean":"2024-09-13T18:15:07.008717+0000","last_became_active":"2024-09-13T18:15:06.034471+0000","last_became_peered":"2024-09-13T18:15:06.034471+0000","last_unstale":"2024-09-13T18:15:07.008717+0000","last_undegraded":"2024-09-13T18:15:07.008717+0000","last_fullsized":"2024-09-13T18:15:07.008717+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:25.493842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.059951+0000","last_change":"2024-09-13T18:15:05.562831+0000","last_active":"2024-09-13T18:15:12.059951+0000","last_peered":"2024-09-13T18:15:12.059951+0000","last_clean":"2024-09-13T18:15:12.059951+0000","last_became_active":"2024-09-13T18:15:05.562530+0000","last_became_peered":"2024-09-13T18:15:05.562530+0000","last_unstale":"2024-09-13T18:15:12.059951+0000","last_undegraded":"2024-09-13T18:15:12.059951+0000","last_fullsized":"2024-09-13T18:15:12.059951+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:00.696204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.659061+0000","last_change":"2024-09-13T18:15:06.019843+0000","last_active":"2024-09-13T18:15:07.659061+0000","last_peered":"2024-09-13T18:15:07.659061+0000","last_clean":"2024-09-13T18:15:07.659061+0000","last_became_active":"2024-09-13T18:15:06.019210+0000","last_became_peered":"2024-09-13T18:15:06.019210+0000","last_unstale":"2024-09-13T18:15:07.659061+0000","last_undegraded":"2024-09-13T18:15:07.659061+0000","last_fullsized":"2024-09-13T18:15:07.659061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:05.552674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.038146+0000","last_change":"2024-09-13T18:15:05.567185+0000","last_active":"2024-09-13T18:15:09.038146+0000","last_peered":"2024-09-13T18:15:09.038146+0000","last_clean":"2024-09-13T18:15:09.038146+0000","last_became_active":"2024-09-13T18:15:05.566489+0000","last_became_peered":"2024-09-13T18:15:05.566489+0000","last_unstale":"2024-09-13T18:15:09.038146+0000","last_undegraded":"2024-09-13T18:15:09.038146+0000","last_fullsized":"2024-09-13T18:15:09.038146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:57.976621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658750+0000","last_change":"2024-09-13T18:15:06.021551+0000","last_active":"2024-09-13T18:15:07.658750+0000","last_peered":"2024-09-13T18:15:07.658750+0000","last_clean":"2024-09-13T18:15:07.658750+0000","last_became_active":"2024-09-13T18:15:06.021097+0000","last_became_peered":"2024-09-13T18:15:06.021097+0000","last_unstale":"2024-09-13T18:15:07.658750+0000","last_undegraded":"2024-09-13T18:15:07.658750+0000","last_fullsized":"2024-09-13T18:15:07.658750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:06.392812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.060251+0000","last_change":"2024-09-13T18:15:05.567190+0000","last_active":"2024-09-13T18:15:12.060251+0000","last_peered":"2024-09-13T18:15:12.060251+0000","last_clean":"2024-09-13T18:15:12.060251+0000","last_became_active":"2024-09-13T18:15:05.566877+0000","last_became_peered":"2024-09-13T18:15:05.566877+0000","last_unstale":"2024-09-13T18:15:12.060251+0000","last_undegraded":"2024-09-13T18:15:12.060251+0000","last_fullsized":"2024-09-13T18:15:12.060251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:59.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060131+0000","last_change":"2024-09-13T18:15:06.031161+0000","last_active":"2024-09-13T18:15:06.060131+0000","last_peered":"2024-09-13T18:15:06.060131+0000","last_clean":"2024-09-13T18:15:06.060131+0000","last_became_active":"2024-09-13T18:15:06.030863+0000","last_became_peered":"2024-09-13T18:15:06.030863+0000","last_unstale":"2024-09-13T18:15:06.060131+0000","last_undegraded":"2024-09-13T18:15:06.060131+0000","last_fullsized":"2024-09-13T18:15:06.060131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:08.786051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.055960+0000","last_change":"2024-09-13T18:15:05.579918+0000","last_active":"2024-09-13T18:15:11.055960+0000","last_peered":"2024-09-13T18:15:11.055960+0000","last_clean":"2024-09-13T18:15:11.055960+0000","last_became_active":"2024-09-13T18:15:05.579542+0000","last_became_peered":"2024-09-13T18:15:05.579542+0000","last_unstale":"2024-09-13T18:15:11.055960+0000","last_undegraded":"2024-09-13T18:15:11.055960+0000","last_fullsized":"2024-09-13T18:15:11.055960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:11.000542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658635+0000","last_change":"2024-09-13T18:15:06.028298+0000","last_active":"2024-09-13T18:15:07.658635+0000","last_peered":"2024-09-13T18:15:07.658635+0000","last_clean":"2024-09-13T18:15:07.658635+0000","last_became_active":"2024-09-13T18:15:06.027978+0000","last_became_peered":"2024-09-13T18:15:06.027978+0000","last_unstale":"2024-09-13T18:15:07.658635+0000","last_undegraded":"2024-09-13T18:15:07.658635+0000","last_fullsized":"2024-09-13T18:15:07.658635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:04.134421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'17","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.060127+0000","last_change":"2024-09-13T18:15:05.569168+0000","last_active":"2024-09-13T18:15:12.060127+0000","last_peered":"2024-09-13T18:15:12.060127+0000","last_clean":"2024-09-13T18:15:12.060127+0000","last_became_active":"2024-09-13T18:15:05.568816+0000","last_became_peered":"2024-09-13T18:15:05.568816+0000","last_unstale":"2024-09-13T18:15:12.060127+0000","last_undegraded":"2024-09-13T18:15:12.060127+0000","last_fullsized":"2024-09-13T18:15:12.060127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:33.113730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20848,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842121+0000","last_change":"2024-09-13T18:15:06.022452+0000","last_active":"2024-09-13T18:15:06.842121+0000","last_peered":"2024-09-13T18:15:06.842121+0000","last_clean":"2024-09-13T18:15:06.842121+0000","last_became_active":"2024-09-13T18:15:06.022167+0000","last_became_peered":"2024-09-13T18:15:06.022167+0000","last_unstale":"2024-09-13T18:15:06.842121+0000","last_undegraded":"2024-09-13T18:15:06.842121+0000","last_fullsized":"2024-09-13T18:15:06.842121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.389512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.044866+0000","last_change":"2024-09-13T18:15:05.575305+0000","last_active":"2024-09-13T18:15:10.044866+0000","last_peered":"2024-09-13T18:15:10.044866+0000","last_clean":"2024-09-13T18:15:10.044866+0000","last_became_active":"2024-09-13T18:15:05.575023+0000","last_became_peered":"2024-09-13T18:15:05.575023+0000","last_unstale":"2024-09-13T18:15:10.044866+0000","last_undegraded":"2024-09-13T18:15:10.044866+0000","last_fullsized":"2024-09-13T18:15:10.044866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.098264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.043268+0000","last_change":"2024-09-13T18:15:06.042275+0000","last_active":"2024-09-13T18:15:06.043268+0000","last_peered":"2024-09-13T18:15:06.043268+0000","last_clean":"2024-09-13T18:15:06.043268+0000","last_became_active":"2024-09-13T18:15:06.041593+0000","last_became_peered":"2024-09-13T18:15:06.041593+0000","last_unstale":"2024-09-13T18:15:06.043268+0000","last_undegraded":"2024-09-13T18:15:06.043268+0000","last_fullsized":"2024-09-13T18:15:06.043268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.550068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.060101+0000","last_change":"2024-09-13T18:15:05.569419+0000","last_active":"2024-09-13T18:15:12.060101+0000","last_peered":"2024-09-13T18:15:12.060101+0000","last_clean":"2024-09-13T18:15:12.060101+0000","last_became_active":"2024-09-13T18:15:05.569126+0000","last_became_peered":"2024-09-13T18:15:05.569126+0000","last_unstale":"2024-09-13T18:15:12.060101+0000","last_undegraded":"2024-09-13T18:15:12.060101+0000","last_fullsized":"2024-09-13T18:15:12.060101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:17.133139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927767+0000","last_change":"2024-09-13T18:15:06.029017+0000","last_active":"2024-09-13T18:15:07.927767+0000","last_peered":"2024-09-13T18:15:07.927767+0000","last_clean":"2024-09-13T18:15:07.927767+0000","last_became_active":"2024-09-13T18:15:06.028688+0000","last_became_peered":"2024-09-13T18:15:06.028688+0000","last_unstale":"2024-09-13T18:15:07.927767+0000","last_undegraded":"2024-09-13T18:15:07.927767+0000","last_fullsized":"2024-09-13T18:15:07.927767+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:30.890494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.041715+0000","last_change":"2024-09-13T18:15:05.564102+0000","last_active":"2024-09-13T18:15:10.041715+0000","last_peered":"2024-09-13T18:15:10.041715+0000","last_clean":"2024-09-13T18:15:10.041715+0000","last_became_active":"2024-09-13T18:15:05.563784+0000","last_became_peered":"2024-09-13T18:15:05.563784+0000","last_unstale":"2024-09-13T18:15:10.041715+0000","last_undegraded":"2024-09-13T18:15:10.041715+0000","last_fullsized":"2024-09-13T18:15:10.041715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:38.285940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927678+0000","last_change":"2024-09-13T18:15:06.021229+0000","last_active":"2024-09-13T18:15:07.927678+0000","last_peered":"2024-09-13T18:15:07.927678+0000","last_clean":"2024-09-13T18:15:07.927678+0000","last_became_active":"2024-09-13T18:15:06.021010+0000","last_became_peered":"2024-09-13T18:15:06.021010+0000","last_unstale":"2024-09-13T18:15:07.927678+0000","last_undegraded":"2024-09-13T18:15:07.927678+0000","last_fullsized":"2024-09-13T18:15:07.927678+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:32.149865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'16","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.045253+0000","last_change":"2024-09-13T18:15:05.574442+0000","last_active":"2024-09-13T18:15:10.045253+0000","last_peered":"2024-09-13T18:15:10.045253+0000","last_clean":"2024-09-13T18:15:10.045253+0000","last_became_active":"2024-09-13T18:15:05.574129+0000","last_became_peered":"2024-09-13T18:15:05.574129+0000","last_unstale":"2024-09-13T18:15:10.045253+0000","last_undegraded":"2024-09-13T18:15:10.045253+0000","last_fullsized":"2024-09-13T18:15:10.045253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:26.510710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008239+0000","last_change":"2024-09-13T18:15:06.027258+0000","last_active":"2024-09-13T18:15:07.008239+0000","last_peered":"2024-09-13T18:15:07.008239+0000","last_clean":"2024-09-13T18:15:07.008239+0000","last_became_active":"2024-09-13T18:15:06.026947+0000","last_became_peered":"2024-09-13T18:15:06.026947+0000","last_unstale":"2024-09-13T18:15:07.008239+0000","last_undegraded":"2024-09-13T18:15:07.008239+0000","last_fullsized":"2024-09-13T18:15:07.008239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.227479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842172+0000","last_change":"2024-09-13T18:15:05.561141+0000","last_active":"2024-09-13T18:15:06.842172+0000","last_peered":"2024-09-13T18:15:06.842172+0000","last_clean":"2024-09-13T18:15:06.842172+0000","last_became_active":"2024-09-13T18:15:05.560824+0000","last_became_peered":"2024-09-13T18:15:05.560824+0000","last_unstale":"2024-09-13T18:15:06.842172+0000","last_undegraded":"2024-09-13T18:15:06.842172+0000","last_fullsized":"2024-09-13T18:15:06.842172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:46.213439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077982+0000","last_change":"2024-09-13T18:15:06.020893+0000","last_active":"2024-09-13T18:15:06.077982+0000","last_peered":"2024-09-13T18:15:06.077982+0000","last_clean":"2024-09-13T18:15:06.077982+0000","last_became_active":"2024-09-13T18:15:06.020586+0000","last_became_peered":"2024-09-13T18:15:06.020586+0000","last_unstale":"2024-09-13T18:15:06.077982+0000","last_undegraded":"2024-09-13T18:15:06.077982+0000","last_fullsized":"2024-09-13T18:15:06.077982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:53.793895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.041365+0000","last_change":"2024-09-13T18:15:05.571263+0000","last_active":"2024-09-13T18:15:06.041365+0000","last_peered":"2024-09-13T18:15:06.041365+0000","last_clean":"2024-09-13T18:15:06.041365+0000","last_became_active":"2024-09-13T18:15:05.570520+0000","last_became_peered":"2024-09-13T18:15:05.570520+0000","last_unstale":"2024-09-13T18:15:06.041365+0000","last_undegraded":"2024-09-13T18:15:06.041365+0000","last_fullsized":"2024-09-13T18:15:06.041365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:52.401456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927875+0000","last_change":"2024-09-13T18:15:06.021756+0000","last_active":"2024-09-13T18:15:07.927875+0000","last_peered":"2024-09-13T18:15:07.927875+0000","last_clean":"2024-09-13T18:15:07.927875+0000","last_became_active":"2024-09-13T18:15:06.021398+0000","last_became_peered":"2024-09-13T18:15:06.021398+0000","last_unstale":"2024-09-13T18:15:07.927875+0000","last_undegraded":"2024-09-13T18:15:07.927875+0000","last_fullsized":"2024-09-13T18:15:07.927875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:25.227069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.060274+0000","last_change":"2024-09-13T18:15:05.570164+0000","last_active":"2024-09-13T18:15:12.060274+0000","last_peered":"2024-09-13T18:15:12.060274+0000","last_clean":"2024-09-13T18:15:12.060274+0000","last_became_active":"2024-09-13T18:15:05.569799+0000","last_became_peered":"2024-09-13T18:15:05.569799+0000","last_unstale":"2024-09-13T18:15:12.060274+0000","last_undegraded":"2024-09-13T18:15:12.060274+0000","last_fullsized":"2024-09-13T18:15:12.060274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:07.623426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:08.567230+0000","last_change":"2024-09-13T18:15:06.024555+0000","last_active":"2024-09-13T18:15:08.567230+0000","last_peered":"2024-09-13T18:15:08.567230+0000","last_clean":"2024-09-13T18:15:08.567230+0000","last_became_active":"2024-09-13T18:15:06.023855+0000","last_became_peered":"2024-09-13T18:15:06.023855+0000","last_unstale":"2024-09-13T18:15:08.567230+0000","last_undegraded":"2024-09-13T18:15:08.567230+0000","last_fullsized":"2024-09-13T18:15:08.567230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:04.790167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.042196+0000","last_change":"2024-09-13T18:15:05.578930+0000","last_active":"2024-09-13T18:15:10.042196+0000","last_peered":"2024-09-13T18:15:10.042196+0000","last_clean":"2024-09-13T18:15:10.042196+0000","last_became_active":"2024-09-13T18:15:05.578597+0000","last_became_peered":"2024-09-13T18:15:05.578597+0000","last_unstale":"2024-09-13T18:15:10.042196+0000","last_undegraded":"2024-09-13T18:15:10.042196+0000","last_fullsized":"2024-09-13T18:15:10.042196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:45.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927829+0000","last_change":"2024-09-13T18:15:06.025762+0000","last_active":"2024-09-13T18:15:07.927829+0000","last_peered":"2024-09-13T18:15:07.927829+0000","last_clean":"2024-09-13T18:15:07.927829+0000","last_became_active":"2024-09-13T18:15:06.025523+0000","last_became_peered":"2024-09-13T18:15:06.025523+0000","last_unstale":"2024-09-13T18:15:07.927829+0000","last_undegraded":"2024-09-13T18:15:07.927829+0000","last_fullsized":"2024-09-13T18:15:07.927829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.430133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":326,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.014067+0000","last_change":"2024-09-13T18:13:55.705797+0000","last_active":"2024-09-13T18:15:06.014067+0000","last_peered":"2024-09-13T18:15:06.014067+0000","last_clean":"2024-09-13T18:15:06.014067+0000","last_became_active":"2024-09-13T18:13:55.705398+0000","last_became_peered":"2024-09-13T18:13:55.705398+0000","last_unstale":"2024-09-13T18:15:06.014067+0000","last_undegraded":"2024-09-13T18:15:06.014067+0000","last_fullsized":"2024-09-13T18:15:06.014067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_clean_scrub_stamp":"2024-09-13T18:10:37.078709+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:10.923431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.039295+0000","last_change":"2024-09-13T18:15:05.561809+0000","last_active":"2024-09-13T18:15:09.039295+0000","last_peered":"2024-09-13T18:15:09.039295+0000","last_clean":"2024-09-13T18:15:09.039295+0000","last_became_active":"2024-09-13T18:15:05.561493+0000","last_became_peered":"2024-09-13T18:15:05.561493+0000","last_unstale":"2024-09-13T18:15:09.039295+0000","last_undegraded":"2024-09-13T18:15:09.039295+0000","last_fullsized":"2024-09-13T18:15:09.039295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.166893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008658+0000","last_change":"2024-09-13T18:15:06.029613+0000","last_active":"2024-09-13T18:15:07.008658+0000","last_peered":"2024-09-13T18:15:07.008658+0000","last_clean":"2024-09-13T18:15:07.008658+0000","last_became_active":"2024-09-13T18:15:06.024766+0000","last_became_peered":"2024-09-13T18:15:06.024766+0000","last_unstale":"2024-09-13T18:15:07.008658+0000","last_undegraded":"2024-09-13T18:15:07.008658+0000","last_fullsized":"2024-09-13T18:15:07.008658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:35.673463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.042933+0000","last_change":"2024-09-13T18:15:05.564512+0000","last_active":"2024-09-13T18:15:10.042933+0000","last_peered":"2024-09-13T18:15:10.042933+0000","last_clean":"2024-09-13T18:15:10.042933+0000","last_became_active":"2024-09-13T18:15:05.561695+0000","last_became_peered":"2024-09-13T18:15:05.561695+0000","last_unstale":"2024-09-13T18:15:10.042933+0000","last_undegraded":"2024-09-13T18:15:10.042933+0000","last_fullsized":"2024-09-13T18:15:10.042933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:45.537500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.036639+0000","last_change":"2024-09-13T18:15:06.034056+0000","last_active":"2024-09-13T18:15:06.036639+0000","last_peered":"2024-09-13T18:15:06.036639+0000","last_clean":"2024-09-13T18:15:06.036639+0000","last_became_active":"2024-09-13T18:15:06.030633+0000","last_became_peered":"2024-09-13T18:15:06.030633+0000","last_unstale":"2024-09-13T18:15:06.036639+0000","last_undegraded":"2024-09-13T18:15:06.036639+0000","last_fullsized":"2024-09-13T18:15:06.036639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:58.462828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:10.045433+0000","last_change":"2024-09-13T18:15:05.576585+0000","last_active":"2024-09-13T18:15:10.045433+0000","last_peered":"2024-09-13T18:15:10.045433+0000","last_clean":"2024-09-13T18:15:10.045433+0000","last_became_active":"2024-09-13T18:15:05.576056+0000","last_became_peered":"2024-09-13T18:15:05.576056+0000","last_unstale":"2024-09-13T18:15:10.045433+0000","last_undegraded":"2024-09-13T18:15:10.045433+0000","last_fullsized":"2024-09-13T18:15:10.045433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:25.419342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008269+0000","last_change":"2024-09-13T18:15:06.028288+0000","last_active":"2024-09-13T18:15:07.008269+0000","last_peered":"2024-09-13T18:15:07.008269+0000","last_clean":"2024-09-13T18:15:07.008269+0000","last_became_active":"2024-09-13T18:15:06.028002+0000","last_became_peered":"2024-09-13T18:15:06.028002+0000","last_unstale":"2024-09-13T18:15:07.008269+0000","last_undegraded":"2024-09-13T18:15:07.008269+0000","last_fullsized":"2024-09-13T18:15:07.008269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.258724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.718165+0000","last_change":"2024-09-13T18:15:05.567336+0000","last_active":"2024-09-13T18:15:12.718165+0000","last_peered":"2024-09-13T18:15:12.718165+0000","last_clean":"2024-09-13T18:15:12.718165+0000","last_became_active":"2024-09-13T18:15:05.567050+0000","last_became_peered":"2024-09-13T18:15:05.567050+0000","last_unstale":"2024-09-13T18:15:12.718165+0000","last_undegraded":"2024-09-13T18:15:12.718165+0000","last_fullsized":"2024-09-13T18:15:12.718165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:50.016671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.178982+0000","last_change":"2024-09-13T18:15:06.038088+0000","last_active":"2024-09-13T18:15:07.178982+0000","last_peered":"2024-09-13T18:15:07.178982+0000","last_clean":"2024-09-13T18:15:07.178982+0000","last_became_active":"2024-09-13T18:15:06.037686+0000","last_became_peered":"2024-09-13T18:15:06.037686+0000","last_unstale":"2024-09-13T18:15:07.178982+0000","last_undegraded":"2024-09-13T18:15:07.178982+0000","last_fullsized":"2024-09-13T18:15:07.178982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:50.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.945978+0000","last_change":"2024-09-13T18:15:05.572920+0000","last_active":"2024-09-13T18:15:07.945978+0000","last_peered":"2024-09-13T18:15:07.945978+0000","last_clean":"2024-09-13T18:15:07.945978+0000","last_became_active":"2024-09-13T18:15:05.572611+0000","last_became_peered":"2024-09-13T18:15:05.572611+0000","last_unstale":"2024-09-13T18:15:07.945978+0000","last_undegraded":"2024-09-13T18:15:07.945978+0000","last_fullsized":"2024-09-13T18:15:07.945978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:35.017695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658670+0000","last_change":"2024-09-13T18:15:06.035681+0000","last_active":"2024-09-13T18:15:07.658670+0000","last_peered":"2024-09-13T18:15:07.658670+0000","last_clean":"2024-09-13T18:15:07.658670+0000","last_became_active":"2024-09-13T18:15:06.035353+0000","last_became_peered":"2024-09-13T18:15:06.035353+0000","last_unstale":"2024-09-13T18:15:07.658670+0000","last_undegraded":"2024-09-13T18:15:07.658670+0000","last_fullsized":"2024-09-13T18:15:07.658670+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:09.781692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.055946+0000","last_change":"2024-09-13T18:15:05.578107+0000","last_active":"2024-09-13T18:15:11.055946+0000","last_peered":"2024-09-13T18:15:11.055946+0000","last_clean":"2024-09-13T18:15:11.055946+0000","last_became_active":"2024-09-13T18:15:05.577777+0000","last_became_peered":"2024-09-13T18:15:05.577777+0000","last_unstale":"2024-09-13T18:15:11.055946+0000","last_undegraded":"2024-09-13T18:15:11.055946+0000","last_fullsized":"2024-09-13T18:15:11.055946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:37.573332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.037469+0000","last_change":"2024-09-13T18:15:06.034893+0000","last_active":"2024-09-13T18:15:06.037469+0000","last_peered":"2024-09-13T18:15:06.037469+0000","last_clean":"2024-09-13T18:15:06.037469+0000","last_became_active":"2024-09-13T18:15:06.034421+0000","last_became_peered":"2024-09-13T18:15:06.034421+0000","last_unstale":"2024-09-13T18:15:06.037469+0000","last_undegraded":"2024-09-13T18:15:06.037469+0000","last_fullsized":"2024-09-13T18:15:06.037469+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:23.614971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.056755+0000","last_change":"2024-09-13T18:15:05.561912+0000","last_active":"2024-09-13T18:15:11.056755+0000","last_peered":"2024-09-13T18:15:11.056755+0000","last_clean":"2024-09-13T18:15:11.056755+0000","last_became_active":"2024-09-13T18:15:05.561573+0000","last_became_peered":"2024-09-13T18:15:05.561573+0000","last_unstale":"2024-09-13T18:15:11.056755+0000","last_undegraded":"2024-09-13T18:15:11.056755+0000","last_fullsized":"2024-09-13T18:15:11.056755+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:06.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008892+0000","last_change":"2024-09-13T18:15:06.023273+0000","last_active":"2024-09-13T18:15:07.008892+0000","last_peered":"2024-09-13T18:15:07.008892+0000","last_clean":"2024-09-13T18:15:07.008892+0000","last_became_active":"2024-09-13T18:15:06.022980+0000","last_became_peered":"2024-09-13T18:15:06.022980+0000","last_unstale":"2024-09-13T18:15:07.008892+0000","last_undegraded":"2024-09-13T18:15:07.008892+0000","last_fullsized":"2024-09-13T18:15:07.008892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:40.966317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.038378+0000","last_change":"2024-09-13T18:15:05.568210+0000","last_active":"2024-09-13T18:15:09.038378+0000","last_peered":"2024-09-13T18:15:09.038378+0000","last_clean":"2024-09-13T18:15:09.038378+0000","last_became_active":"2024-09-13T18:15:05.567881+0000","last_became_peered":"2024-09-13T18:15:05.567881+0000","last_unstale":"2024-09-13T18:15:09.038378+0000","last_undegraded":"2024-09-13T18:15:09.038378+0000","last_fullsized":"2024-09-13T18:15:09.038378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.808041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060113+0000","last_change":"2024-09-13T18:15:06.038795+0000","last_active":"2024-09-13T18:15:06.060113+0000","last_peered":"2024-09-13T18:15:06.060113+0000","last_clean":"2024-09-13T18:15:06.060113+0000","last_became_active":"2024-09-13T18:15:06.038511+0000","last_became_peered":"2024-09-13T18:15:06.038511+0000","last_unstale":"2024-09-13T18:15:06.060113+0000","last_undegraded":"2024-09-13T18:15:06.060113+0000","last_fullsized":"2024-09-13T18:15:06.060113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:07.584249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.037347+0000","last_change":"2024-09-13T18:15:05.574322+0000","last_active":"2024-09-13T18:15:09.037347+0000","last_peered":"2024-09-13T18:15:09.037347+0000","last_clean":"2024-09-13T18:15:09.037347+0000","last_became_active":"2024-09-13T18:15:05.573958+0000","last_became_peered":"2024-09-13T18:15:05.573958+0000","last_unstale":"2024-09-13T18:15:09.037347+0000","last_undegraded":"2024-09-13T18:15:09.037347+0000","last_fullsized":"2024-09-13T18:15:09.037347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:46.878632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842013+0000","last_change":"2024-09-13T18:15:06.022444+0000","last_active":"2024-09-13T18:15:06.842013+0000","last_peered":"2024-09-13T18:15:06.842013+0000","last_clean":"2024-09-13T18:15:06.842013+0000","last_became_active":"2024-09-13T18:15:06.022134+0000","last_became_peered":"2024-09-13T18:15:06.022134+0000","last_unstale":"2024-09-13T18:15:06.842013+0000","last_undegraded":"2024-09-13T18:15:06.842013+0000","last_fullsized":"2024-09-13T18:15:06.842013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:36.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.059396+0000","last_change":"2024-09-13T18:15:05.559112+0000","last_active":"2024-09-13T18:15:12.059396+0000","last_peered":"2024-09-13T18:15:12.059396+0000","last_clean":"2024-09-13T18:15:12.059396+0000","last_became_active":"2024-09-13T18:15:05.558757+0000","last_became_peered":"2024-09-13T18:15:05.558757+0000","last_unstale":"2024-09-13T18:15:12.059396+0000","last_undegraded":"2024-09-13T18:15:12.059396+0000","last_fullsized":"2024-09-13T18:15:12.059396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:57.691324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.077952+0000","last_change":"2024-09-13T18:15:06.032621+0000","last_active":"2024-09-13T18:15:06.077952+0000","last_peered":"2024-09-13T18:15:06.077952+0000","last_clean":"2024-09-13T18:15:06.077952+0000","last_became_active":"2024-09-13T18:15:06.032321+0000","last_became_peered":"2024-09-13T18:15:06.032321+0000","last_unstale":"2024-09-13T18:15:06.077952+0000","last_undegraded":"2024-09-13T18:15:06.077952+0000","last_fullsized":"2024-09-13T18:15:06.077952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:59.695094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.007441+0000","last_change":"2024-09-13T18:15:05.571633+0000","last_active":"2024-09-13T18:15:06.007441+0000","last_peered":"2024-09-13T18:15:06.007441+0000","last_clean":"2024-09-13T18:15:06.007441+0000","last_became_active":"2024-09-13T18:15:05.571292+0000","last_became_peered":"2024-09-13T18:15:05.571292+0000","last_unstale":"2024-09-13T18:15:06.007441+0000","last_undegraded":"2024-09-13T18:15:06.007441+0000","last_fullsized":"2024-09-13T18:15:06.007441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.452906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008666+0000","last_change":"2024-09-13T18:15:06.045725+0000","last_active":"2024-09-13T18:15:07.008666+0000","last_peered":"2024-09-13T18:15:07.008666+0000","last_clean":"2024-09-13T18:15:07.008666+0000","last_became_active":"2024-09-13T18:15:06.045401+0000","last_became_peered":"2024-09-13T18:15:06.045401+0000","last_unstale":"2024-09-13T18:15:07.008666+0000","last_undegraded":"2024-09-13T18:15:07.008666+0000","last_fullsized":"2024-09-13T18:15:07.008666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:30.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:09.037165+0000","last_change":"2024-09-13T18:15:05.567295+0000","last_active":"2024-09-13T18:15:09.037165+0000","last_peered":"2024-09-13T18:15:09.037165+0000","last_clean":"2024-09-13T18:15:09.037165+0000","last_became_active":"2024-09-13T18:15:05.566992+0000","last_became_peered":"2024-09-13T18:15:05.566992+0000","last_unstale":"2024-09-13T18:15:09.037165+0000","last_undegraded":"2024-09-13T18:15:09.037165+0000","last_fullsized":"2024-09-13T18:15:09.037165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:27.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.927588+0000","last_change":"2024-09-13T18:15:06.036750+0000","last_active":"2024-09-13T18:15:07.927588+0000","last_peered":"2024-09-13T18:15:07.927588+0000","last_clean":"2024-09-13T18:15:07.927588+0000","last_became_active":"2024-09-13T18:15:06.036424+0000","last_became_peered":"2024-09-13T18:15:06.036424+0000","last_unstale":"2024-09-13T18:15:07.927588+0000","last_undegraded":"2024-09-13T18:15:07.927588+0000","last_fullsized":"2024-09-13T18:15:07.927588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:49.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008526+0000","last_change":"2024-09-13T18:15:06.027697+0000","last_active":"2024-09-13T18:15:07.008526+0000","last_peered":"2024-09-13T18:15:07.008526+0000","last_clean":"2024-09-13T18:15:07.008526+0000","last_became_active":"2024-09-13T18:15:06.027402+0000","last_became_peered":"2024-09-13T18:15:06.027402+0000","last_unstale":"2024-09-13T18:15:07.008526+0000","last_undegraded":"2024-09-13T18:15:07.008526+0000","last_fullsized":"2024-09-13T18:15:07.008526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:45.004828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.842103+0000","last_change":"2024-09-13T18:15:05.562459+0000","last_active":"2024-09-13T18:15:06.842103+0000","last_peered":"2024-09-13T18:15:06.842103+0000","last_clean":"2024-09-13T18:15:06.842103+0000","last_became_active":"2024-09-13T18:15:05.562107+0000","last_became_peered":"2024-09-13T18:15:05.562107+0000","last_unstale":"2024-09-13T18:15:06.842103+0000","last_undegraded":"2024-09-13T18:15:06.842103+0000","last_fullsized":"2024-09-13T18:15:06.842103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:39.740829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.658527+0000","last_change":"2024-09-13T18:15:06.027566+0000","last_active":"2024-09-13T18:15:07.658527+0000","last_peered":"2024-09-13T18:15:07.658527+0000","last_clean":"2024-09-13T18:15:07.658527+0000","last_became_active":"2024-09-13T18:15:06.027271+0000","last_became_peered":"2024-09-13T18:15:06.027271+0000","last_unstale":"2024-09-13T18:15:07.658527+0000","last_undegraded":"2024-09-13T18:15:07.658527+0000","last_fullsized":"2024-09-13T18:15:07.658527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:37.929848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:11.054130+0000","last_change":"2024-09-13T18:15:05.567206+0000","last_active":"2024-09-13T18:15:11.054130+0000","last_peered":"2024-09-13T18:15:11.054130+0000","last_clean":"2024-09-13T18:15:11.054130+0000","last_became_active":"2024-09-13T18:15:05.566905+0000","last_became_peered":"2024-09-13T18:15:05.566905+0000","last_unstale":"2024-09-13T18:15:11.054130+0000","last_undegraded":"2024-09-13T18:15:11.054130+0000","last_fullsized":"2024-09-13T18:15:11.054130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:56.498418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:15:06.060122+0000","last_change":"2024-09-13T18:15:06.041388+0000","last_active":"2024-09-13T18:15:06.060122+0000","last_peered":"2024-09-13T18:15:06.060122+0000","last_clean":"2024-09-13T18:15:06.060122+0000","last_became_active":"2024-09-13T18:15:06.041102+0000","last_became_peered":"2024-09-13T18:15:06.041102+0000","last_unstale":"2024-09-13T18:15:06.060122+0000","last_undegraded":"2024-09-13T18:15:06.060122+0000","last_fullsized":"2024-09-13T18:15:06.060122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:13.919598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:08.381360+0000","last_change":"2024-09-13T18:15:05.573970+0000","last_active":"2024-09-13T18:15:08.381360+0000","last_peered":"2024-09-13T18:15:08.381360+0000","last_clean":"2024-09-13T18:15:08.381360+0000","last_became_active":"2024-09-13T18:15:05.571778+0000","last_became_peered":"2024-09-13T18:15:05.571778+0000","last_unstale":"2024-09-13T18:15:08.381360+0000","last_undegraded":"2024-09-13T18:15:08.381360+0000","last_fullsized":"2024-09-13T18:15:08.381360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:52.799646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:07.008775+0000","last_change":"2024-09-13T18:15:06.025563+0000","last_active":"2024-09-13T18:15:07.008775+0000","last_peered":"2024-09-13T18:15:07.008775+0000","last_clean":"2024-09-13T18:15:07.008775+0000","last_became_active":"2024-09-13T18:15:06.025257+0000","last_became_peered":"2024-09-13T18:15:06.025257+0000","last_unstale":"2024-09-13T18:15:07.008775+0000","last_undegraded":"2024-09-13T18:15:07.008775+0000","last_fullsized":"2024-09-13T18:15:07.008775+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:52.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:15:12.716440+0000","last_change":"2024-09-13T18:15:05.562126+0000","last_active":"2024-09-13T18:15:12.716440+0000","last_peered":"2024-09-13T18:15:12.716440+0000","last_clean":"2024-09-13T18:15:12.716440+0000","last_became_active":"2024-09-13T18:15:05.561646+0000","last_became_peered":"2024-09-13T18:15:05.561646+0000","last_unstale":"2024-09-13T18:15:12.716440+0000","last_undegraded":"2024-09-13T18:15:12.716440+0000","last_fullsized":"2024-09-13T18:15:12.716440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":26146,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":176,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":78728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":933888,"data_stored":442504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":10,"up_from":73,"seq":313532612625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1054773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.498},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.434}]},{"osd":2,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.622},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70299999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53400000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.64700000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776151,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":442268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.501}]},{"osd":3,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.44600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.872}]},{"osd":8,"last update":"Fri Sep 13 18:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.754},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.89200000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.92200000000000004}]}]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":442098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.38700000000000001,"15min":0.39500000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45200000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.42299999999999999,"15min":0.42999999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.52600000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66000000000000003,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70199999999999996,"5min":0.747,"15min":0.747},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.52300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.371},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.47199999999999998,"15min":0.48399999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60899999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61399999999999999,"15min":0.624},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83999999999999997,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.624}]},{"osd":7,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48799999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68500000000000005}]},{"osd":10,"last update":"Fri Sep 13 18:14:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":7,"up_from":52,"seq":223338299424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1035627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73399999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.443}]},{"osd":1,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35199999999999998,"15min":0.34899999999999998},"min":{"1min":0.23799999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.38600000000000001},"min":{"1min":0.26300000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.36499999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77900000000000003,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55200000000000005,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.78500000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.433},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88900000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.45000000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63,"15min":0.627},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63600000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.54000000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:14:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.621},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462949,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36108,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709044,"statfs":{"total":95995035648,"available":95958061056,"internally_reserved":0,"allocated":921600,"data_stored":441360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.375,"5min":0.318,"15min":0.318},"max":{"1min":0.77800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54500000000000004,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82099999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86899999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.51900000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94999999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.044,"15min":1.044},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2130000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.497,"5min":0.379,"15min":0.379},"max":{"1min":1.1799999999999999,"5min":1.397,"15min":1.397},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.51000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.53300000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93899999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.204,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.505}]},{"osd":5,"last update":"Fri Sep 13 18:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.59999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97999999999999998,"5min":1.22,"15min":1.22},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.52100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1459999999999999,"5min":1.486,"15min":1.486},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:14:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.59899999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.875},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.48899999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56899999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":0.92300000000000004,"15min":0.83399999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":11.670999999999999,"5min":11.670999999999999,"15min":11.670999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88200000000000001,"15min":0.872},"min":{"1min":0.69599999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.96999999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64300000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.01}]}]},{"osd":5,"up_from":39,"seq":167503724588,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32636,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712516,"statfs":{"total":95995035648,"available":95961616384,"internally_reserved":0,"allocated":1560576,"data_stored":1034728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81200000000000006,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.497},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":1.175,"15min":1.175},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.504,"15min":0.496},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76700000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.501,"15min":0.48999999999999999},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83599999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77800000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81299999999999994,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.82699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79700000000000004,"5min":0.873,"15min":0.873},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71899999999999997}]},{"osd":8,"last update":"Fri Sep 13 18:15:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.495,"15min":0.498},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.81100000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77400000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.748}]}]},{"osd":4,"up_from":34,"seq":146028888111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":933888,"data_stored":441956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.48999999999999999},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.37},"min":{"1min":0.24299999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48299999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38600000000000001,"15min":0.39300000000000002},"min":{"1min":0.23400000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.54800000000000004},"min":{"1min":0.46899999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.442,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:14:19 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73099999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.46999999999999997},"min":{"1min":0.32000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39800000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:15:05 2024","interfaces":[{"interface":"back","average":{"1min":1.9790000000000001,"5min":0.871,"15min":0.68700000000000006},"min":{"1min":0.56499999999999995,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":18.643000000000001,"5min":18.643000000000001,"15min":18.643000000000001},"last":0.504},{"interface":"front","average":{"1min":2.044,"5min":0.90100000000000002,"15min":0.71099999999999997},"min":{"1min":0.60499999999999998,"5min":0.502,"15min":0.502},"max":{"1min":18.629999999999999,"5min":18.629999999999999,"15min":18.629999999999999},"last":0.75600000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:14:31 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68400000000000005}]},{"osd":10,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":3,"up_from":26,"seq":111669149747,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":950272,"data_stored":441576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.34000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81299999999999994,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.65800000000000003,"15min":0.62},"min":{"1min":0.61399999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.52800000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.80800000000000005,"5min":1.012,"15min":1.012},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.67500000000000004},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90000000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:14:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84499999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47399999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":0.999,"15min":0.999},"last":0.748}]},{"osd":8,"last update":"Fri Sep 13 18:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.88},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.1499999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.45700000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:14:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411385,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":443532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.56299999999999994},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68899999999999995,"5min":1.097,"15min":1.097},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.35399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.52500000000000002},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83199999999999996,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80700000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":1.159,"15min":1.159},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.312,"5min":0.311,"15min":0.311},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80700000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:14:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.38700000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72499999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.435,"15min":0.41499999999999998},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68000000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:14:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.48399999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71999999999999997,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52300000000000002,"15min":0.51500000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.64900000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.79400000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:14:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.69399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":463912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53800000000000003,"15min":0.51500000000000001},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0389999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.311,"5min":0.252,"15min":0.252},"max":{"1min":0.65100000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.63},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:15:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.42499999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":1.427,"15min":1.427},"last":0.496}]},{"osd":4,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.39100000000000001},"min":{"1min":0.29399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.45300000000000001,"15min":0.439},"min":{"1min":0.318,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:14:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.45500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.52600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.62},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:14:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.29499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.51700000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.621}]},{"osd":8,"last update":"Fri Sep 13 18:15:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56999999999999995,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.75},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.65200000000000002,"15min":0.64400000000000002},"min":{"1min":0.503,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.78300000000000003}]},{"osd":9,"last update":"Fri Sep 13 18:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85699999999999998}]},{"osd":10,"last update":"Fri Sep 13 18:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71399999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.57299999999999995,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0109999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.626}]},{"osd":2,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60899999999999999,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.58199999999999996,"15min":0.54600000000000004},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.46700000000000003,"15min":0.442},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.49399999999999999,"15min":0.45400000000000001},"min":{"1min":0.38500000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.61199999999999999,"15min":0.59599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.55800000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:14:23 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.629,"15min":0.60799999999999998},"min":{"1min":0.53500000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.046},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.63300000000000001,"15min":0.61899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:14:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.755,"15min":0.751},"min":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69699999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:15:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0569999999999999,"5min":1.153,"15min":1.153},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.84399999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.083,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0049999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68700000000000006}]},{"osd":10,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.083}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":39850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:15:14.752 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:15:14.752 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T18:15:14.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T18:15:15.104 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:15.353 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:15 smithi007 ceph-mon[30588]: from='client.24713 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:15:15.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:15 smithi007 ceph-mon[30588]: pgmap v289: 97 pgs: 97 active+clean; 602 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 8.6 KiB/s wr, 22 op/s 2024-09-13T18:15:15.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:15 smithi116 ceph-mon[35109]: from='client.24713 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:15:15.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:15 smithi116 ceph-mon[35109]: pgmap v289: 97 pgs: 97 active+clean; 602 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 8.6 KiB/s wr, 22 op/s 2024-09-13T18:15:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:15 smithi067 ceph-mon[35103]: from='client.24713 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:15:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:15 smithi067 ceph-mon[35103]: pgmap v289: 97 pgs: 97 active+clean; 602 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 8.6 KiB/s wr, 22 op/s 2024-09-13T18:15:16.247 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:16 smithi007 ceph-mon[30588]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:15:16.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:16 smithi116 ceph-mon[35109]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:15:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:16 smithi067 ceph-mon[35103]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:15:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 -- 172.21.15.7:0/1305894694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 msgr2=0x7fb52c103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 --2- 172.21.15.7:0/1305894694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c103690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb518009900 tx=0x7fb51802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 -- 172.21.15.7:0/1305894694 shutdown_connections 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 --2- 172.21.15.7:0/1305894694 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb52c103bd0 0x7fb52c10a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 --2- 172.21.15.7:0/1305894694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c103690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 --2- 172.21.15.7:0/1305894694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb52c102010 0x7fb52c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 -- 172.21.15.7:0/1305894694 >> 172.21.15.7:0/1305894694 conn(0x7fb52c0fd7a0 msgr2=0x7fb52c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 -- 172.21.15.7:0/1305894694 shutdown_connections 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.937+0000 7fb533600640 1 -- 172.21.15.7:0/1305894694 wait complete. 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.938+0000 7fb533600640 1 Processor -- start 2024-09-13T18:15:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.938+0000 7fb533600640 1 -- start start 2024-09-13T18:15:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb533600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb52c102010 0x7fb52c197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb533600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb533600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb52c103bd0 0x7fb52c19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb533600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c19faf0 con 0x7fb52c103210 2024-09-13T18:15:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb533600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c19fc60 con 0x7fb52c103bd0 2024-09-13T18:15:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb533600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c19fe20 con 0x7fb52c102010 2024-09-13T18:15:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb52be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb530c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb52c102010 0x7fb52c197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb52be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45854/0 (socket says 172.21.15.7:45854) 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb52be00640 1 -- 172.21.15.7:0/3176176410 learned_addr learned my addr 172.21.15.7:0/3176176410 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb531600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb52c103bd0 0x7fb52c19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb52be00640 1 -- 172.21.15.7:0/3176176410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb52c102010 msgr2=0x7fb52c197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.939+0000 7fb52be00640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb52c102010 0x7fb52c197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb52be00640 1 -- 172.21.15.7:0/3176176410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb52c103bd0 msgr2=0x7fb52c19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb52be00640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb52c103bd0 0x7fb52c19f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb52be00640 1 -- 172.21.15.7:0/3176176410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518009560 con 0x7fb52c103210 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb52be00640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c198530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb518031500 tx=0x7fb518003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb529600640 1 -- 172.21.15.7:0/3176176410 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518003e00 con 0x7fb52c103210 2024-09-13T18:15:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb529600640 1 -- 172.21.15.7:0/3176176410 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb518031c70 con 0x7fb52c103210 2024-09-13T18:15:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb529600640 1 -- 172.21.15.7:0/3176176410 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51803bd80 con 0x7fb52c103210 2024-09-13T18:15:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52c1a00a0 con 0x7fb52c103210 2024-09-13T18:15:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.940+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52c1a04f0 con 0x7fb52c103210 2024-09-13T18:15:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.941+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52c109500 con 0x7fb52c103210 2024-09-13T18:15:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.943+0000 7fb529600640 1 -- 172.21.15.7:0/3176176410 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fb51803b460 con 0x7fb52c103210 2024-09-13T18:15:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.944+0000 7fb529600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb5140a1140 0x7fb5140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.945+0000 7fb529600640 1 -- 172.21.15.7:0/3176176410 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb5180ed2a0 con 0x7fb52c103210 2024-09-13T18:15:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.945+0000 7fb530c00640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb5140a1140 0x7fb5140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.945+0000 7fb530c00640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb5140a1140 0x7fb5140a3600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb52c103070 tx=0x7fb520005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:16.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:16.948+0000 7fb529600640 1 -- 172.21.15.7:0/3176176410 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb5180b6a30 con 0x7fb52c103210 2024-09-13T18:15:17.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.198+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb52c02c3e0 con 0x7fb52c103210 2024-09-13T18:15:17.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.202+0000 7fb529600640 1 -- 172.21.15.7:0/3176176410 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb5180ba050 con 0x7fb52c103210 2024-09-13T18:15:17.205 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-13T18:15:17.205 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQA1geRmwVngCxAAH8kJP6AA+r7pHWH1VC2GwA== 2024-09-13T18:15:17.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb5140a1140 msgr2=0x7fb5140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:17.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb5140a1140 0x7fb5140a3600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb52c103070 tx=0x7fb520005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:17.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 msgr2=0x7fb52c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c198530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb518031500 tx=0x7fb518003c10 comp rx=0 tx=0).stop 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 shutdown_connections 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb5140a1140 0x7fb5140a3600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb52c103bd0 0x7fb52c19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb52c103210 0x7fb52c198530 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 --2- 172.21.15.7:0/3176176410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb52c102010 0x7fb52c197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 >> 172.21.15.7:0/3176176410 conn(0x7fb52c0fd7a0 msgr2=0x7fb52c1066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 shutdown_connections 2024-09-13T18:15:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:17.205+0000 7fb533600640 1 -- 172.21.15.7:0/3176176410 wait complete. 2024-09-13T18:15:17.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:17 smithi067 ceph-mon[35103]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.5 KiB/s wr, 23 op/s 2024-09-13T18:15:17.247 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:15:16 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: 2024-09-13T18:15:16.983+0000 7f1eed9fa640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-13T18:15:17.247 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:15:16 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: 2024-09-13T18:15:16.983+0000 7f1eed9fa640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-13T18:15:17.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:17 smithi116 ceph-mon[35109]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.5 KiB/s wr, 23 op/s 2024-09-13T18:15:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:17 smithi007 ceph-mon[30588]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 8.5 KiB/s wr, 23 op/s 2024-09-13T18:15:18.016 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:15:18.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T18:15:18.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:15:18.100 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:15:18.100 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:15:18.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T18:15:18.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:18 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3176176410' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:15:18.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:18 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3176176410' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:15:18.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:18 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3176176410' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:15:18.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:18 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3176176410' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:15:18.461 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:18.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:18 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3176176410' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:15:18.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:18 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3176176410' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:15:19.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:19 smithi007 ceph-mon[30588]: pgmap v291: 97 pgs: 97 active+clean; 626 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 KiB/s wr, 23 op/s 2024-09-13T18:15:19.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:19 smithi116 ceph-mon[35109]: pgmap v291: 97 pgs: 97 active+clean; 626 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 KiB/s wr, 23 op/s 2024-09-13T18:15:19.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:19 smithi067 ceph-mon[35103]: pgmap v291: 97 pgs: 97 active+clean; 626 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 KiB/s wr, 23 op/s 2024-09-13T18:15:20.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.251+0000 7f8342c00640 1 -- 172.21.15.7:0/3617278399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c1065f0 msgr2=0x7f833c1069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:20.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.251+0000 7f8342c00640 1 --2- 172.21.15.7:0/3617278399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c1065f0 0x7f833c1069d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f832c009900 tx=0x7f832c02a400 comp rx=0 tx=0).stop 2024-09-13T18:15:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.252+0000 7f8342c00640 1 -- 172.21.15.7:0/3617278399 shutdown_connections 2024-09-13T18:15:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.252+0000 7f8342c00640 1 --2- 172.21.15.7:0/3617278399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f833c10b720 0x7f833c1132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.252+0000 7f8342c00640 1 --2- 172.21.15.7:0/3617278399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c106fa0 0x7f833c10aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.252+0000 7f8342c00640 1 --2- 172.21.15.7:0/3617278399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c1065f0 0x7f833c1069d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.252+0000 7f8342c00640 1 -- 172.21.15.7:0/3617278399 >> 172.21.15.7:0/3617278399 conn(0x7f833c075d10 msgr2=0x7f833c078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.252+0000 7f8342c00640 1 -- 172.21.15.7:0/3617278399 shutdown_connections 2024-09-13T18:15:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.252+0000 7f8342c00640 1 -- 172.21.15.7:0/3617278399 wait complete. 2024-09-13T18:15:20.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 Processor -- start 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 -- start start 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c1065f0 0x7f833c1a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f833c106fa0 0x7f833c1a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c10b720 0x7f833c19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c19cdb0 con 0x7f833c1065f0 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c19cf20 con 0x7f833c106fa0 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f8342c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c19d0e0 con 0x7f833c10b720 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.253+0000 7f833be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c1065f0 0x7f833c1a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8333400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f833c106fa0 0x7f833c1a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f833be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c1065f0 0x7f833c1a25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45874/0 (socket says 172.21.15.7:45874) 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f833be00640 1 -- 172.21.15.7:0/1083223043 learned_addr learned my addr 172.21.15.7:0/1083223043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8340c00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c10b720 0x7f833c19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8333400640 1 -- 172.21.15.7:0/1083223043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c10b720 msgr2=0x7f833c19c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8333400640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c10b720 0x7f833c19c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8333400640 1 -- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c1065f0 msgr2=0x7f833c1a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8333400640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c1065f0 0x7f833c1a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8333400640 1 -- 172.21.15.7:0/1083223043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c009560 con 0x7f833c106fa0 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f833be00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c1065f0 0x7f833c1a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.254+0000 7f8333400640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f833c106fa0 0x7f833c1a2b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f832400e9c0 tx=0x7f832400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.255+0000 7f8339600640 1 -- 172.21.15.7:0/1083223043 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400ccc0 con 0x7f833c106fa0 2024-09-13T18:15:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.255+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c19d3c0 con 0x7f833c106fa0 2024-09-13T18:15:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.255+0000 7f8339600640 1 -- 172.21.15.7:0/1083223043 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f832400ce20 con 0x7f833c106fa0 2024-09-13T18:15:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.255+0000 7f8339600640 1 -- 172.21.15.7:0/1083223043 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83240187e0 con 0x7f833c106fa0 2024-09-13T18:15:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.255+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c1a95b0 con 0x7f833c106fa0 2024-09-13T18:15:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.256+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c107ad0 con 0x7f833c106fa0 2024-09-13T18:15:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.258+0000 7f8339600640 1 -- 172.21.15.7:0/1083223043 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f8324010430 con 0x7f833c106fa0 2024-09-13T18:15:20.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.259+0000 7f8339600640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f83200a1190 0x7f83200a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:20.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.259+0000 7f8339600640 1 -- 172.21.15.7:0/1083223043 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8324014070 con 0x7f833c106fa0 2024-09-13T18:15:20.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.259+0000 7f833be00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f83200a1190 0x7f83200a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:20.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.260+0000 7f833be00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f83200a1190 0x7f83200a3650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f832c000c00 tx=0x7f832c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:20.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.261+0000 7f8339600640 1 -- 172.21.15.7:0/1083223043 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83240963d0 con 0x7f833c106fa0 2024-09-13T18:15:20.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.490+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f833c1069d0 con 0x7f833c106fa0 2024-09-13T18:15:20.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.495+0000 7f8339600640 1 -- 172.21.15.7:0/1083223043 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260277 (secure 0 0 0) 0x7f83240999f0 con 0x7f833c106fa0 2024-09-13T18:15:20.504 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.499+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f83200a1190 msgr2=0x7f83200a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f83200a1190 0x7f83200a3650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f832c000c00 tx=0x7f832c005a20 comp rx=0 tx=0).stop 2024-09-13T18:15:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f833c106fa0 msgr2=0x7f833c1a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f833c106fa0 0x7f833c1a2b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f832400e9c0 tx=0x7f832400ee80 comp rx=0 tx=0).stop 2024-09-13T18:15:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 shutdown_connections 2024-09-13T18:15:20.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f83200a1190 0x7f83200a3650 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f833c10b720 0x7f833c19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f833c106fa0 0x7f833c1a2b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 --2- 172.21.15.7:0/1083223043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f833c1065f0 0x7f833c1a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:20.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 >> 172.21.15.7:0/1083223043 conn(0x7f833c075d10 msgr2=0x7f833c077220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:20.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 shutdown_connections 2024-09-13T18:15:20.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:20.500+0000 7f8342c00640 1 -- 172.21.15.7:0/1083223043 wait complete. 2024-09-13T18:15:20.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:20 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1083223043' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:15:20.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:20 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1083223043' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:15:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:20 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1083223043' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:15:21.242 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1436660417},{"type":"v1","addr":"172.21.15.7:6801","nonce":1436660417}]},"active_addr":"172.21.15.7:6801/1436660417","active_change":"2024-09-13T18:08:08.423357+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3413020614}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1869741794}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3049309851}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":4207444935}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":1507285002}]}]} 2024-09-13T18:15:21.248 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T18:15:21.248 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T18:15:21.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:15:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:21.862 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:21 smithi116 ceph-mon[35109]: pgmap v292: 97 pgs: 97 active+clean; 626 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.8 KiB/s wr, 22 op/s 2024-09-13T18:15:21.871 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:21 smithi007 ceph-mon[30588]: pgmap v292: 97 pgs: 97 active+clean; 626 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.8 KiB/s wr, 22 op/s 2024-09-13T18:15:21.901 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:21 smithi067 ceph-mon[35103]: pgmap v292: 97 pgs: 97 active+clean; 626 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.8 KiB/s wr, 22 op/s 2024-09-13T18:15:23.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 -- 172.21.15.7:0/3572487108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 msgr2=0x7f4cb41049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:23.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/3572487108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 0x7f4cb41049f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009900 tx=0x7f4ca002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 -- 172.21.15.7:0/3572487108 shutdown_connections 2024-09-13T18:15:23.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/3572487108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb4105120 0x7f4cb410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/3572487108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 0x7f4cb41049f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/3572487108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb40ffff0 0x7f4cb41003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 -- 172.21.15.7:0/3572487108 >> 172.21.15.7:0/3572487108 conn(0x7f4cb40fba90 msgr2=0x7f4cb40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:23.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.507+0000 7f4cbbe00640 1 -- 172.21.15.7:0/3572487108 shutdown_connections 2024-09-13T18:15:23.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.508+0000 7f4cbbe00640 1 -- 172.21.15.7:0/3572487108 wait complete. 2024-09-13T18:15:23.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.508+0000 7f4cbbe00640 1 Processor -- start 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.508+0000 7f4cbbe00640 1 -- start start 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cbbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb40ffff0 0x7f4cb40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cbbe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 0x7f4cb4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cbbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb4105120 0x7f4cb4073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cbbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb41a4720 con 0x7f4cb40ffff0 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cbbe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb41a4890 con 0x7f4cb4105120 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cbbe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb41a4a50 con 0x7f4cb41009a0 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cb9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb40ffff0 0x7f4cb40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cb8a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 0x7f4cb4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cb9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb40ffff0 0x7f4cb40727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45884/0 (socket says 172.21.15.7:45884) 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cb9400640 1 -- 172.21.15.7:0/2026929579 learned_addr learned my addr 172.21.15.7:0/2026929579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:23.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.509+0000 7f4cb9e00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb4105120 0x7f4cb4073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb9400640 1 -- 172.21.15.7:0/2026929579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 msgr2=0x7f4cb4072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb9400640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 0x7f4cb4072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb9400640 1 -- 172.21.15.7:0/2026929579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb4105120 msgr2=0x7f4cb4073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb9400640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb4105120 0x7f4cb4073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb9400640 1 -- 172.21.15.7:0/2026929579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac009840 con 0x7f4cb40ffff0 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb9400640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb40ffff0 0x7f4cb40727b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800e9f0 tx=0x7f4ca800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb2000640 1 -- 172.21.15.7:0/2026929579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8009720 con 0x7f4cb40ffff0 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb2000640 1 -- 172.21.15.7:0/2026929579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ca80054e0 con 0x7f4cb40ffff0 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca0009560 con 0x7f4cb40ffff0 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cb2000640 1 -- 172.21.15.7:0/2026929579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8010430 con 0x7f4cb40ffff0 2024-09-13T18:15:23.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.510+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb41a5070 con 0x7f4cb40ffff0 2024-09-13T18:15:23.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.512+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb41014d0 con 0x7f4cb40ffff0 2024-09-13T18:15:23.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.513+0000 7f4cb2000640 1 -- 172.21.15.7:0/2026929579 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f4ca8004ff0 con 0x7f4cb40ffff0 2024-09-13T18:15:23.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.515+0000 7f4cb2000640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c9c0a1190 0x7f4c9c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:23.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.515+0000 7f4cb2000640 1 -- 172.21.15.7:0/2026929579 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4ca8014070 con 0x7f4cb40ffff0 2024-09-13T18:15:23.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.515+0000 7f4cb8a00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c9c0a1190 0x7f4c9c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:23.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.516+0000 7f4cb8a00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c9c0a1190 0x7f4c9c0a3650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0000c00 tx=0x7f4ca0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:23.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.519+0000 7f4cb2000640 1 -- 172.21.15.7:0/2026929579 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ca80cee60 con 0x7f4cb40ffff0 2024-09-13T18:15:23.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.703+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cb4073ce0 con 0x7f4cb40ffff0 2024-09-13T18:15:23.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.705+0000 7f4cb2000640 1 -- 172.21.15.7:0/2026929579 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+21989 (secure 0 0 0) 0x7f4ca80963a0 con 0x7f4cb40ffff0 2024-09-13T18:15:23.708 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:23.708 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:15:07.004369+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:15:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.707+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c9c0a1190 msgr2=0x7f4c9c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.707+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c9c0a1190 0x7f4c9c0a3650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0000c00 tx=0x7f4ca0005e80 comp rx=0 tx=0).stop 2024-09-13T18:15:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.707+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb40ffff0 msgr2=0x7f4cb40727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.707+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb40ffff0 0x7f4cb40727b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800e9f0 tx=0x7f4ca800edf0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.707+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 shutdown_connections 2024-09-13T18:15:23.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.708+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4c9c0a1190 0x7f4c9c0a3650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.708+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cb4105120 0x7f4cb4073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.708+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cb41009a0 0x7f4cb4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.708+0000 7f4cbbe00640 1 --2- 172.21.15.7:0/2026929579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb40ffff0 0x7f4cb40727b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.708+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 >> 172.21.15.7:0/2026929579 conn(0x7f4cb40fba90 msgr2=0x7f4cb40fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.708+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 shutdown_connections 2024-09-13T18:15:23.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:23.708+0000 7f4cbbe00640 1 -- 172.21.15.7:0/2026929579 wait complete. 2024-09-13T18:15:23.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:23 smithi007 ceph-mon[30588]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 25 op/s 2024-09-13T18:15:23.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:23 smithi116 ceph-mon[35109]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 25 op/s 2024-09-13T18:15:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:23 smithi067 ceph-mon[35103]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 25 op/s 2024-09-13T18:15:24.471 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T18:15:24.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:15:24.791 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:24.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:24 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2026929579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:24.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:24 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2026929579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:24 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2026929579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:25.950 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:25 smithi007 ceph-mon[30588]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 20 op/s 2024-09-13T18:15:25.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:25 smithi116 ceph-mon[35109]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 20 op/s 2024-09-13T18:15:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:25 smithi067 ceph-mon[35103]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 20 op/s 2024-09-13T18:15:26.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 -- 172.21.15.7:0/1660943679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60102200 msgr2=0x7efc601025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:26.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 --2- 172.21.15.7:0/1660943679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60102200 0x7efc601025e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc50009cd0 tx=0x7efc5002a8f0 comp rx=0 tx=0).stop 2024-09-13T18:15:26.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 -- 172.21.15.7:0/1660943679 shutdown_connections 2024-09-13T18:15:26.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 --2- 172.21.15.7:0/1660943679 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc60107330 0x7efc6010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:26.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 --2- 172.21.15.7:0/1660943679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 0x7efc60106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:26.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 --2- 172.21.15.7:0/1660943679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60102200 0x7efc601025e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:26.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 -- 172.21.15.7:0/1660943679 >> 172.21.15.7:0/1660943679 conn(0x7efc600fdc60 msgr2=0x7efc60100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:26.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 -- 172.21.15.7:0/1660943679 shutdown_connections 2024-09-13T18:15:26.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.891+0000 7efc65400640 1 -- 172.21.15.7:0/1660943679 wait complete. 2024-09-13T18:15:26.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 Processor -- start 2024-09-13T18:15:26.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 -- start start 2024-09-13T18:15:26.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc60102200 0x7efc60198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:26.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 0x7efc60198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:26.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60107330 0x7efc6019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:26.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6019d4b0 con 0x7efc60102bb0 2024-09-13T18:15:26.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6019d620 con 0x7efc60107330 2024-09-13T18:15:26.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.893+0000 7efc65400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6019d790 con 0x7efc60102200 2024-09-13T18:15:26.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc55e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 0x7efc60198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:26.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60107330 0x7efc6019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:26.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60107330 0x7efc6019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:45260/0 (socket says 172.21.15.7:45260) 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc55e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 0x7efc60198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60660/0 (socket says 172.21.15.7:60660) 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 -- 172.21.15.7:0/300914715 learned_addr learned my addr 172.21.15.7:0/300914715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5e800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc60102200 0x7efc60198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 -- 172.21.15.7:0/300914715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc60102200 msgr2=0x7efc60198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc60102200 0x7efc60198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 -- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 msgr2=0x7efc60198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 0x7efc60198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 -- 172.21.15.7:0/300914715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50009900 con 0x7efc60107330 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc55e00640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 0x7efc60198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5e800640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc60102200 0x7efc60198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.894+0000 7efc5f200640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60107330 0x7efc6019ceb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e970 tx=0x7efc5800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.895+0000 7efc57e00640 1 -- 172.21.15.7:0/300914715 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58009720 con 0x7efc60107330 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.895+0000 7efc57e00640 1 -- 172.21.15.7:0/300914715 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc580054e0 con 0x7efc60107330 2024-09-13T18:15:26.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.895+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6019da70 con 0x7efc60107330 2024-09-13T18:15:26.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.895+0000 7efc57e00640 1 -- 172.21.15.7:0/300914715 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58010430 con 0x7efc60107330 2024-09-13T18:15:26.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.895+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc601a5330 con 0x7efc60107330 2024-09-13T18:15:26.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.896+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc601036e0 con 0x7efc60107330 2024-09-13T18:15:26.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.898+0000 7efc57e00640 1 -- 172.21.15.7:0/300914715 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7efc5800ccc0 con 0x7efc60107330 2024-09-13T18:15:26.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.899+0000 7efc57e00640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7efc440a1190 0x7efc440a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:26.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.899+0000 7efc57e00640 1 -- 172.21.15.7:0/300914715 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efc58014070 con 0x7efc60107330 2024-09-13T18:15:26.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.900+0000 7efc5e800640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7efc440a1190 0x7efc440a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:26.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.900+0000 7efc5e800640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7efc440a1190 0x7efc440a3650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc50000f80 tx=0x7efc50030440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:26.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:26.904+0000 7efc57e00640 1 -- 172.21.15.7:0/300914715 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc58096520 con 0x7efc60107330 2024-09-13T18:15:27.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.084+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc601998d0 con 0x7efc60107330 2024-09-13T18:15:27.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.086+0000 7efc57e00640 1 -- 172.21.15.7:0/300914715 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+21989 (secure 0 0 0) 0x7efc58099b40 con 0x7efc60107330 2024-09-13T18:15:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:15:27.089 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:15:07.004369+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:15:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7efc440a1190 msgr2=0x7efc440a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:27.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7efc440a1190 0x7efc440a3650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc50000f80 tx=0x7efc50030440 comp rx=0 tx=0).stop 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60107330 msgr2=0x7efc6019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60107330 0x7efc6019ceb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e970 tx=0x7efc5800ed70 comp rx=0 tx=0).stop 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 shutdown_connections 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7efc440a1190 0x7efc440a3650 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc60107330 0x7efc6019ceb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc60102bb0 0x7efc60198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 --2- 172.21.15.7:0/300914715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc60102200 0x7efc60198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 >> 172.21.15.7:0/300914715 conn(0x7efc600fdc60 msgr2=0x7efc600ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 shutdown_connections 2024-09-13T18:15:27.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:27.088+0000 7efc65400640 1 -- 172.21.15.7:0/300914715 wait complete. 2024-09-13T18:15:27.760 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:27 smithi007 ceph-mon[30588]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-13T18:15:27.760 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:27 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/300914715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:27.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T18:15:27.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T18:15:27.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T18:15:27.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T18:15:27.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T18:15:27.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T18:15:27.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-13T18:15:27.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-13T18:15:27.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-13T18:15:27.795 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-13T18:15:27.795 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-13T18:15:27.796 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-13T18:15:27.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:27 smithi116 ceph-mon[35109]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-13T18:15:27.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:27 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/300914715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:27.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:27 smithi067 ceph-mon[35103]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-13T18:15:27.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:27 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/300914715' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:15:28.657 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:28.661 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:28.668 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:28.676 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:29.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:29 smithi007 ceph-mon[30588]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-13T18:15:29.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:29 smithi116 ceph-mon[35109]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-13T18:15:29.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:29 smithi067 ceph-mon[35103]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-09-13T18:15:30.743 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:30 smithi007 ceph-mon[30588]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-13T18:15:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:30 smithi116 ceph-mon[35109]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-13T18:15:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:30 smithi067 ceph-mon[35103]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-13T18:15:31.237 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:31.239 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:31.240 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:31.241 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:32.884 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:32 smithi007 ceph-mon[30588]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-13T18:15:32.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:32 smithi116 ceph-mon[35109]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-13T18:15:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:32 smithi067 ceph-mon[35103]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-13T18:15:33.604 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:33.605 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:33.605 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 -- 172.21.15.7:0/2704157469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80107330 msgr2=0x7fad8010eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 --2- 172.21.15.7:0/2704157469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80107330 0x7fad8010eeb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad78009cd0 tx=0x7fad7802a8e0 comp rx=0 tx=0).stop 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 -- 172.21.15.7:0/2704157469 shutdown_connections 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 --2- 172.21.15.7:0/2704157469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80107330 0x7fad8010eeb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 --2- 172.21.15.7:0/2704157469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad80102bb0 0x7fad80106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 --2- 172.21.15.7:0/2704157469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad80102200 0x7fad801025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 -- 172.21.15.7:0/2704157469 >> 172.21.15.7:0/2704157469 conn(0x7fad800fdc60 msgr2=0x7fad80100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 -- 172.21.15.7:0/2704157469 shutdown_connections 2024-09-13T18:15:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.577+0000 7fad87200640 1 -- 172.21.15.7:0/2704157469 wait complete. 2024-09-13T18:15:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.578+0000 7fad87200640 1 Processor -- start 2024-09-13T18:15:34.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.578+0000 7fad87200640 1 -- start start 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad87200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad80102200 0x7fad801984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad87200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80102bb0 0x7fad801989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad87200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad80107330 0x7fad8019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad87200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8019d3f0 con 0x7fad80102bb0 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad87200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8019d560 con 0x7fad80107330 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad87200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8019d6d0 con 0x7fad80102200 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80102bb0 0x7fad801989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80102bb0 0x7fad801989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57400/0 (socket says 172.21.15.7:57400) 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 -- 172.21.15.7:0/779610897 learned_addr learned my addr 172.21.15.7:0/779610897 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad85200640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad80107330 0x7fad8019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7fe00640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad80102200 0x7fad801984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 -- 172.21.15.7:0/779610897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad80102200 msgr2=0x7fad801984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad80102200 0x7fad801984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 -- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad80107330 msgr2=0x7fad8019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad80107330 0x7fad8019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.579+0000 7fad7f400640 1 -- 172.21.15.7:0/779610897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78009900 con 0x7fad80102bb0 2024-09-13T18:15:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.580+0000 7fad7f400640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80102bb0 0x7fad801989f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00d950 tx=0x7fad6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.580+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c009a30 con 0x7fad80102bb0 2024-09-13T18:15:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.580+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad6c009b90 con 0x7fad80102bb0 2024-09-13T18:15:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.580+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0047a0 con 0x7fad80102bb0 2024-09-13T18:15:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.580+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8019d9b0 con 0x7fad80102bb0 2024-09-13T18:15:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.580+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad801a5270 con 0x7fad80102bb0 2024-09-13T18:15:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.581+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad801122c0 con 0x7fad80102bb0 2024-09-13T18:15:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.583+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fad6c009d00 con 0x7fad80102bb0 2024-09-13T18:15:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.585+0000 7fad7cc00640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad640a1110 0x7fad640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.585+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fad6c0cca00 con 0x7fad80102bb0 2024-09-13T18:15:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.586+0000 7fad7fe00640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad640a1110 0x7fad640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.586+0000 7fad7cc00640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] conn(0x7fad640aa960 0x7fad640acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.586+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 --> [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad640ad430 con 0x7fad640aa960 2024-09-13T18:15:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.586+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6c0ccd70 con 0x7fad80102bb0 2024-09-13T18:15:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.586+0000 7fad7fe00640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad640a1110 0x7fad640a35d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad70009bd0 tx=0x7fad70005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.586+0000 7fad85200640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] conn(0x7fad640aa960 0x7fad640acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:34.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.587+0000 7fad85200640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] conn(0x7fad640aa960 0x7fad640acd80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:34.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.588+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== osd.1 v2:172.21.15.67:6800/1600577441 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fad640ad430 con 0x7fad640aa960 2024-09-13T18:15:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.602+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 --> [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad80060bb0 con 0x7fad640aa960 2024-09-13T18:15:34.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.603+0000 7fad7cc00640 1 -- 172.21.15.7:0/779610897 <== osd.1 v2:172.21.15.67:6800/1600577441 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad80060bb0 con 0x7fad640aa960 2024-09-13T18:15:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.603+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] conn(0x7fad640aa960 msgr2=0x7fad640acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.603+0000 7fad87200640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] conn(0x7fad640aa960 0x7fad640acd80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad640a1110 msgr2=0x7fad640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fad640a1110 0x7fad640a35d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad70009bd0 tx=0x7fad70005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80102bb0 msgr2=0x7fad801989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 --2- 172.21.15.7:0/779610897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad80102bb0 0x7fad801989f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00d950 tx=0x7fad6c00de10 comp rx=0 tx=0).stop 2024-09-13T18:15:34.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad85200640 1 -- 172.21.15.7:0/779610897 reap_dead start 2024-09-13T18:15:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 shutdown_connections 2024-09-13T18:15:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 >> 172.21.15.7:0/779610897 conn(0x7fad800fdc60 msgr2=0x7fad800ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 shutdown_connections 2024-09-13T18:15:34.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:34.604+0000 7fad87200640 1 -- 172.21.15.7:0/779610897 wait complete. 2024-09-13T18:15:34.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:34 smithi007 ceph-mon[30588]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:34.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:34 smithi116 ceph-mon[35109]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:34 smithi067 ceph-mon[35103]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:36.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:36 smithi116 ceph-mon[35109]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:36 smithi067 ceph-mon[35103]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:37.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:36 smithi007 ceph-mon[30588]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 -- 172.21.15.7:0/3649543100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3958105120 msgr2=0x7f395810cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 --2- 172.21.15.7:0/3649543100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3958105120 0x7f395810cca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3950009cd0 tx=0x7f395002a8e0 comp rx=0 tx=0).stop 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 -- 172.21.15.7:0/3649543100 shutdown_connections 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 --2- 172.21.15.7:0/3649543100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3958105120 0x7f395810cca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 --2- 172.21.15.7:0/3649543100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39581009a0 0x7f39581049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 --2- 172.21.15.7:0/3649543100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39580ffff0 0x7f39581003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 -- 172.21.15.7:0/3649543100 >> 172.21.15.7:0/3649543100 conn(0x7f39580fba90 msgr2=0x7f39580fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:37.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 -- 172.21.15.7:0/3649543100 shutdown_connections 2024-09-13T18:15:37.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.161+0000 7f395d400640 1 -- 172.21.15.7:0/3649543100 wait complete. 2024-09-13T18:15:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.162+0000 7f395d400640 1 Processor -- start 2024-09-13T18:15:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.162+0000 7f395d400640 1 -- start start 2024-09-13T18:15:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f395d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39580ffff0 0x7f3958198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f395d400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39581009a0 0x7f39581989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f395d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3958105120 0x7f395819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f395d400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395819d3d0 con 0x7f39580ffff0 2024-09-13T18:15:37.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f395d400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395819d540 con 0x7f3958105120 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f395d400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395819d6b0 con 0x7f39581009a0 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f3956800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39580ffff0 0x7f3958198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f3956800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39580ffff0 0x7f3958198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57412/0 (socket says 172.21.15.7:57412) 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f3956800640 1 -- 172.21.15.7:0/3068646176 learned_addr learned my addr 172.21.15.7:0/3068646176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f3955e00640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39581009a0 0x7f39581989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.163+0000 7f3957200640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3958105120 0x7f395819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f3956800640 1 -- 172.21.15.7:0/3068646176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39581009a0 msgr2=0x7f39581989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f3956800640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39581009a0 0x7f39581989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f3956800640 1 -- 172.21.15.7:0/3068646176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3958105120 msgr2=0x7f395819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f3956800640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3958105120 0x7f395819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f3956800640 1 -- 172.21.15.7:0/3068646176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950009900 con 0x7f39580ffff0 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f3955e00640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39581009a0 0x7f39581989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:37.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f3956800640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39580ffff0 0x7f3958198490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f394800d950 tx=0x7f394800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948009a30 con 0x7f39580ffff0 2024-09-13T18:15:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3948009b90 con 0x7f39580ffff0 2024-09-13T18:15:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480047a0 con 0x7f39580ffff0 2024-09-13T18:15:37.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.164+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395819d990 con 0x7f39580ffff0 2024-09-13T18:15:37.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.165+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39581a5250 con 0x7f39580ffff0 2024-09-13T18:15:37.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.165+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39581100a0 con 0x7f39580ffff0 2024-09-13T18:15:37.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.167+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f3948009d00 con 0x7f39580ffff0 2024-09-13T18:15:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.168+0000 7f394f400640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f393c0a1190 0x7f393c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.169+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f39480cca40 con 0x7f39580ffff0 2024-09-13T18:15:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.169+0000 7f3955e00640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f393c0a1190 0x7f393c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.169+0000 7f394f400640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] conn(0x7f393c0aa9e0 0x7f393c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:37.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.169+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 --> [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f393c0ad4b0 con 0x7f393c0aa9e0 2024-09-13T18:15:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.169+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39480ccdb0 con 0x7f39580ffff0 2024-09-13T18:15:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.169+0000 7f3957200640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] conn(0x7f393c0aa9e0 0x7f393c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.169+0000 7f3955e00640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f393c0a1190 0x7f393c0a3650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3958199a40 tx=0x7f3944005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:37.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.170+0000 7f3957200640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] conn(0x7f393c0aa9e0 0x7f393c0ace00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:37.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.171+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== osd.9 v2:172.21.15.7:6826/2537283667 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f393c0ad4b0 con 0x7f393c0aa9e0 2024-09-13T18:15:37.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.185+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 --> [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f39581014d0 con 0x7f393c0aa9e0 2024-09-13T18:15:37.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.185+0000 7f394f400640 1 -- 172.21.15.7:0/3068646176 <== osd.9 v2:172.21.15.7:6826/2537283667 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f39581014d0 con 0x7f393c0aa9e0 2024-09-13T18:15:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.185+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] conn(0x7f393c0aa9e0 msgr2=0x7f393c0ace00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.185+0000 7f395d400640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] conn(0x7f393c0aa9e0 0x7f393c0ace00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f393c0a1190 msgr2=0x7f393c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f393c0a1190 0x7f393c0a3650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3958199a40 tx=0x7f3944005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39580ffff0 msgr2=0x7f3958198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 --2- 172.21.15.7:0/3068646176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f39580ffff0 0x7f3958198490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f394800d950 tx=0x7f394800de10 comp rx=0 tx=0).stop 2024-09-13T18:15:37.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f3957200640 1 -- 172.21.15.7:0/3068646176 reap_dead start 2024-09-13T18:15:37.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 shutdown_connections 2024-09-13T18:15:37.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 >> 172.21.15.7:0/3068646176 conn(0x7f39580fba90 msgr2=0x7f39580fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:37.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 shutdown_connections 2024-09-13T18:15:37.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:37.186+0000 7f395d400640 1 -- 172.21.15.7:0/3068646176 wait complete. 2024-09-13T18:15:38.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.090+0000 7f434c800640 1 -- 172.21.15.7:0/3711744839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43441009a0 msgr2=0x7f43441049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:38.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.090+0000 7f434c800640 1 --2- 172.21.15.7:0/3711744839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43441009a0 0x7f43441049f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4334009930 tx=0x7f433402a420 comp rx=0 tx=0).stop 2024-09-13T18:15:38.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.090+0000 7f434c800640 1 -- 172.21.15.7:0/3711744839 shutdown_connections 2024-09-13T18:15:38.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.090+0000 7f434c800640 1 --2- 172.21.15.7:0/3711744839 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4344105120 0x7f434410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.090+0000 7f434c800640 1 --2- 172.21.15.7:0/3711744839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43441009a0 0x7f43441049f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.090+0000 7f434c800640 1 --2- 172.21.15.7:0/3711744839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43440ffff0 0x7f43441003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.090+0000 7f434c800640 1 -- 172.21.15.7:0/3711744839 >> 172.21.15.7:0/3711744839 conn(0x7f43440fba90 msgr2=0x7f43440fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.091+0000 7f434c800640 1 -- 172.21.15.7:0/3711744839 shutdown_connections 2024-09-13T18:15:38.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.091+0000 7f434c800640 1 -- 172.21.15.7:0/3711744839 wait complete. 2024-09-13T18:15:38.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.091+0000 7f434c800640 1 Processor -- start 2024-09-13T18:15:38.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434c800640 1 -- start start 2024-09-13T18:15:38.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434c800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43440ffff0 0x7f4344198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434c800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43441009a0 0x7f4344198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434c800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4344105120 0x7f434419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434c800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434419d4a0 con 0x7f4344105120 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434c800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434419d610 con 0x7f43440ffff0 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434c800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434419d780 con 0x7f43441009a0 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f4349e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43440ffff0 0x7f4344198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f4349e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43440ffff0 0x7f4344198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:42140/0 (socket says 172.21.15.7:42140) 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f4349e00640 1 -- 172.21.15.7:0/2004684922 learned_addr learned my addr 172.21.15.7:0/2004684922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f434a800640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4344105120 0x7f434419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.092+0000 7f4349400640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43441009a0 0x7f4344198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.093+0000 7f4349e00640 1 -- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43441009a0 msgr2=0x7f4344198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:38.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.093+0000 7f4349e00640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43441009a0 0x7f4344198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.093+0000 7f4349e00640 1 -- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4344105120 msgr2=0x7f434419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.093+0000 7f4349e00640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4344105120 0x7f434419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.093+0000 7f4349e00640 1 -- 172.21.15.7:0/2004684922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334009560 con 0x7f43440ffff0 2024-09-13T18:15:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.093+0000 7f4349e00640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43440ffff0 0x7f4344198560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f433800e9f0 tx=0x7f433800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.093+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338009700 con 0x7f43440ffff0 2024-09-13T18:15:38.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.094+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434419da60 con 0x7f43440ffff0 2024-09-13T18:15:38.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.094+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f433800cd80 con 0x7f43440ffff0 2024-09-13T18:15:38.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.094+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338018860 con 0x7f43440ffff0 2024-09-13T18:15:38.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.094+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43441a5320 con 0x7f43440ffff0 2024-09-13T18:15:38.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.095+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4344110080 con 0x7f43440ffff0 2024-09-13T18:15:38.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.097+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f43380189c0 con 0x7f43440ffff0 2024-09-13T18:15:38.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.098+0000 7f433ea00640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f432c0a1190 0x7f432c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:38.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.098+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4338014070 con 0x7f43440ffff0 2024-09-13T18:15:38.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.098+0000 7f4349400640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f432c0a1190 0x7f432c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:38.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.098+0000 7f433ea00640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] conn(0x7f432c0aa9e0 0x7f432c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:38.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.098+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 --> [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f432c0ad4b0 con 0x7f432c0aa9e0 2024-09-13T18:15:38.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.098+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43380cd5f0 con 0x7f43440ffff0 2024-09-13T18:15:38.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.099+0000 7f434a800640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] conn(0x7f432c0aa9e0 0x7f432c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:38.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.099+0000 7f4349400640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f432c0a1190 0x7f432c0a3650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4334031440 tx=0x7f4334005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:38.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.099+0000 7f434a800640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] conn(0x7f432c0aa9e0 0x7f432c0ace00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:38.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.100+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== osd.2 v2:172.21.15.116:6800/3932152081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f432c0ad4b0 con 0x7f432c0aa9e0 2024-09-13T18:15:38.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.114+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 --> [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f43441014d0 con 0x7f432c0aa9e0 2024-09-13T18:15:38.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f433ea00640 1 -- 172.21.15.7:0/2004684922 <== osd.2 v2:172.21.15.116:6800/3932152081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f43441014d0 con 0x7f432c0aa9e0 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] conn(0x7f432c0aa9e0 msgr2=0x7f432c0ace00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] conn(0x7f432c0aa9e0 0x7f432c0ace00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f432c0a1190 msgr2=0x7f432c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f432c0a1190 0x7f432c0a3650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4334031440 tx=0x7f4334005a20 comp rx=0 tx=0).stop 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43440ffff0 msgr2=0x7f4344198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 --2- 172.21.15.7:0/2004684922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43440ffff0 0x7f4344198560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f433800e9f0 tx=0x7f433800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434a800640 1 -- 172.21.15.7:0/2004684922 reap_dead start 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 shutdown_connections 2024-09-13T18:15:38.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 >> 172.21.15.7:0/2004684922 conn(0x7f43440fba90 msgr2=0x7f43440fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.115+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 shutdown_connections 2024-09-13T18:15:38.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:38.116+0000 7f434c800640 1 -- 172.21.15.7:0/2004684922 wait complete. 2024-09-13T18:15:38.929 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:38 smithi007 ceph-mon[30588]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T18:15:38.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:38 smithi116 ceph-mon[35109]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T18:15:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:38 smithi067 ceph-mon[35103]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T18:15:40.216 INFO:teuthology.orchestra.run.smithi007.stdout:55834574915 2024-09-13T18:15:40.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T18:15:40.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:40 smithi007 ceph-mon[30588]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:40 smithi116 ceph-mon[35109]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:40 smithi067 ceph-mon[35103]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:15:42.953 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:42 smithi007 ceph-mon[30588]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:15:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:42 smithi116 ceph-mon[35109]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:15:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:42 smithi067 ceph-mon[35103]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:15:44.294 INFO:teuthology.orchestra.run.smithi007.stdout:292057776156 2024-09-13T18:15:44.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-13T18:15:44.916 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:44 smithi007 ceph-mon[30588]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:44.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 -- 172.21.15.7:0/3496945768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948107140 msgr2=0x7f394810ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 --2- 172.21.15.7:0/3496945768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948107140 0x7f394810ecc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3940009cd0 tx=0x7f394002a8e0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 -- 172.21.15.7:0/3496945768 shutdown_connections 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 --2- 172.21.15.7:0/3496945768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948107140 0x7f394810ecc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 --2- 172.21.15.7:0/3496945768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39481029c0 0x7f3948106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 --2- 172.21.15.7:0/3496945768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3948102010 0x7f39481023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 -- 172.21.15.7:0/3496945768 >> 172.21.15.7:0/3496945768 conn(0x7f39480fda70 msgr2=0x7f39480ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 -- 172.21.15.7:0/3496945768 shutdown_connections 2024-09-13T18:15:44.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.937+0000 7f394de00640 1 -- 172.21.15.7:0/3496945768 wait complete. 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.938+0000 7f394de00640 1 Processor -- start 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.938+0000 7f394de00640 1 -- start start 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948102010 0x7f3948198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39481029c0 0x7f39481987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948107140 0x7f394819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394de00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394819d180 con 0x7f3948102010 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394de00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394819d2f0 con 0x7f39481029c0 2024-09-13T18:15:44.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394de00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394819d460 con 0x7f3948107140 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948102010 0x7f3948198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948102010 0x7f3948198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54248/0 (socket says 172.21.15.7:54248) 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 -- 172.21.15.7:0/2993845793 learned_addr learned my addr 172.21.15.7:0/2993845793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f393fe00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39481029c0 0x7f39481987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394d400640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948107140 0x7f394819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 -- 172.21.15.7:0/2993845793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948107140 msgr2=0x7f394819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948107140 0x7f394819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 -- 172.21.15.7:0/2993845793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39481029c0 msgr2=0x7f39481987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39481029c0 0x7f39481987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f394ca00640 1 -- 172.21.15.7:0/2993845793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940009900 con 0x7f3948102010 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.939+0000 7f393fe00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39481029c0 0x7f39481987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:44.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.940+0000 7f394ca00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948102010 0x7f3948198290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f393800e9f0 tx=0x7f393800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:44.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.940+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938009700 con 0x7f3948102010 2024-09-13T18:15:44.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.940+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f393800cd80 con 0x7f3948102010 2024-09-13T18:15:44.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.940+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394819d740 con 0x7f3948102010 2024-09-13T18:15:44.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.940+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938018860 con 0x7f3948102010 2024-09-13T18:15:44.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.940+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39481a5000 con 0x7f3948102010 2024-09-13T18:15:44.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.941+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39481120e0 con 0x7f3948102010 2024-09-13T18:15:44.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.943+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f39380189c0 con 0x7f3948102010 2024-09-13T18:15:44.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.944+0000 7f3946000640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f392c0a1100 0x7f392c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:44.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.945+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3938014070 con 0x7f3948102010 2024-09-13T18:15:44.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.945+0000 7f393fe00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f392c0a1100 0x7f392c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:44.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.945+0000 7f3946000640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] conn(0x7f392c0aa950 0x7f392c0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.945+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 --> [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f392c0ad420 con 0x7f392c0aa950 2024-09-13T18:15:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.945+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39380cd6d0 con 0x7f3948102010 2024-09-13T18:15:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.945+0000 7f394d400640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] conn(0x7f392c0aa950 0x7f392c0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.945+0000 7f393fe00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f392c0a1100 0x7f392c0a35c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f39481997f0 tx=0x7f393000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:44.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.946+0000 7f394d400640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] conn(0x7f392c0aa950 0x7f392c0acd70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:44.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.947+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== osd.3 v2:172.21.15.7:6810/1622258084 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f392c0ad420 con 0x7f392c0aa950 2024-09-13T18:15:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:44 smithi116 ceph-mon[35109]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 --> [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f39481034f0 con 0x7f392c0aa950 2024-09-13T18:15:44.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f3946000640 1 -- 172.21.15.7:0/2993845793 <== osd.3 v2:172.21.15.7:6810/1622258084 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f39481034f0 con 0x7f392c0aa950 2024-09-13T18:15:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] conn(0x7f392c0aa950 msgr2=0x7f392c0acd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f394de00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] conn(0x7f392c0aa950 0x7f392c0acd70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f392c0a1100 msgr2=0x7f392c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f394de00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f392c0a1100 0x7f392c0a35c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f39481997f0 tx=0x7f393000b410 comp rx=0 tx=0).stop 2024-09-13T18:15:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948102010 msgr2=0x7f3948198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.961+0000 7f394de00640 1 --2- 172.21.15.7:0/2993845793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3948102010 0x7f3948198290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f393800e9f0 tx=0x7f393800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.962+0000 7f394d400640 1 -- 172.21.15.7:0/2993845793 reap_dead start 2024-09-13T18:15:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.962+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 shutdown_connections 2024-09-13T18:15:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.962+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 >> 172.21.15.7:0/2993845793 conn(0x7f39480fda70 msgr2=0x7f39480fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.962+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 shutdown_connections 2024-09-13T18:15:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:44.962+0000 7f394de00640 1 -- 172.21.15.7:0/2993845793 wait complete. 2024-09-13T18:15:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:44 smithi067 ceph-mon[35103]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.215+0000 7f36ca200640 1 -- 172.21.15.7:0/678419066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c4104f40 msgr2=0x7f36c410cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:45.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.215+0000 7f36ca200640 1 --2- 172.21.15.7:0/678419066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c4104f40 0x7f36c410cac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009cd0 tx=0x7f36bc02a8e0 comp rx=0 tx=0).stop 2024-09-13T18:15:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.215+0000 7f36ca200640 1 -- 172.21.15.7:0/678419066 shutdown_connections 2024-09-13T18:15:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.215+0000 7f36ca200640 1 --2- 172.21.15.7:0/678419066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c4104f40 0x7f36c410cac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.215+0000 7f36ca200640 1 --2- 172.21.15.7:0/678419066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36c41007c0 0x7f36c4104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.215+0000 7f36ca200640 1 --2- 172.21.15.7:0/678419066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36c40ffe10 0x7f36c41001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.216+0000 7f36ca200640 1 -- 172.21.15.7:0/678419066 >> 172.21.15.7:0/678419066 conn(0x7f36c40fb870 msgr2=0x7f36c40fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.216+0000 7f36ca200640 1 -- 172.21.15.7:0/678419066 shutdown_connections 2024-09-13T18:15:45.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.216+0000 7f36ca200640 1 -- 172.21.15.7:0/678419066 wait complete. 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.217+0000 7f36ca200640 1 Processor -- start 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.217+0000 7f36ca200640 1 -- start start 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.217+0000 7f36ca200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36c40ffe10 0x7f36c41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.217+0000 7f36ca200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c41007c0 0x7f36c4198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36ca200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36c4104f40 0x7f36c419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36ca200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419d210 con 0x7f36c41007c0 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36ca200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419d380 con 0x7f36c40ffe10 2024-09-13T18:15:45.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36ca200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419d4f0 con 0x7f36c4104f40 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c41007c0 0x7f36c4198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36c40ffe10 0x7f36c41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c41007c0 0x7f36c4198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57446/0 (socket says 172.21.15.7:57446) 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 -- 172.21.15.7:0/890242741 learned_addr learned my addr 172.21.15.7:0/890242741 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c9800640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36c4104f40 0x7f36c419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 -- 172.21.15.7:0/890242741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36c4104f40 msgr2=0x7f36c419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36c4104f40 0x7f36c419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 -- 172.21.15.7:0/890242741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36c40ffe10 msgr2=0x7f36c41982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36c40ffe10 0x7f36c41982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c3e00640 1 -- 172.21.15.7:0/890242741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b8009490 con 0x7f36c41007c0 2024-09-13T18:15:45.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.218+0000 7f36c8e00640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36c40ffe10 0x7f36c41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.219+0000 7f36c3e00640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c41007c0 0x7f36c4198810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f36b000d950 tx=0x7f36b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.219+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0009a30 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.219+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc009900 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.219+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36b0009b90 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.219+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00047a0 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.219+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c41a4ec0 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.220+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36c41012f0 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.222+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f36b0009d00 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.223+0000 7f36c1600640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36ac0a1100 0x7f36ac0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.223+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f36b00cc3d0 con 0x7f36c41007c0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.224+0000 7f36c8e00640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36ac0a1100 0x7f36ac0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:45.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.224+0000 7f36c1600640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] conn(0x7f36ac0aa950 0x7f36ac0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.224+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 --> [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36ac0ad420 con 0x7f36ac0aa950 2024-09-13T18:15:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.224+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36b00ce9b0 con 0x7f36c41007c0 2024-09-13T18:15:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.224+0000 7f36c9800640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] conn(0x7f36ac0aa950 0x7f36ac0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.224+0000 7f36c8e00640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36ac0a1100 0x7f36ac0a35c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f36b8011630 tx=0x7f36b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.225+0000 7f36c9800640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] conn(0x7f36ac0aa950 0x7f36ac0acd70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.225+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== osd.6 v2:172.21.15.7:6818/967037099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f36ac0ad420 con 0x7f36ac0aa950 2024-09-13T18:15:45.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.239+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 --> [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36c410c0d0 con 0x7f36ac0aa950 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36c1600640 1 -- 172.21.15.7:0/890242741 <== osd.6 v2:172.21.15.7:6818/967037099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f36c410c0d0 con 0x7f36ac0aa950 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] conn(0x7f36ac0aa950 msgr2=0x7f36ac0acd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] conn(0x7f36ac0aa950 0x7f36ac0acd70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36ac0a1100 msgr2=0x7f36ac0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f36ac0a1100 0x7f36ac0a35c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f36b8011630 tx=0x7f36b8005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c41007c0 msgr2=0x7f36c4198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 --2- 172.21.15.7:0/890242741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36c41007c0 0x7f36c4198810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f36b000d950 tx=0x7f36b000de10 comp rx=0 tx=0).stop 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36c9800640 1 -- 172.21.15.7:0/890242741 reap_dead start 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 shutdown_connections 2024-09-13T18:15:45.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.240+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 >> 172.21.15.7:0/890242741 conn(0x7f36c40fb870 msgr2=0x7f36c40fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:45.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.241+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 shutdown_connections 2024-09-13T18:15:45.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:42.241+0000 7f36ca200640 1 -- 172.21.15.7:0/890242741 wait complete. 2024-09-13T18:15:46.049 INFO:teuthology.orchestra.run.smithi007.stdout:201863462956 2024-09-13T18:15:46.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-13T18:15:46.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.266+0000 7f886f800640 1 -- 172.21.15.7:0/2389718668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102200 msgr2=0x7f88681025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:46.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.266+0000 7f886f800640 1 --2- 172.21.15.7:0/2389718668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102200 0x7f88681025e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f885c009860 tx=0x7f885c02a340 comp rx=0 tx=0).stop 2024-09-13T18:15:46.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.267+0000 7f886f800640 1 -- 172.21.15.7:0/2389718668 shutdown_connections 2024-09-13T18:15:46.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.267+0000 7f886f800640 1 --2- 172.21.15.7:0/2389718668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8868107330 0x7f886810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.267+0000 7f886f800640 1 --2- 172.21.15.7:0/2389718668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8868102bb0 0x7f8868106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.267+0000 7f886f800640 1 --2- 172.21.15.7:0/2389718668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102200 0x7f88681025e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.267+0000 7f886f800640 1 -- 172.21.15.7:0/2389718668 >> 172.21.15.7:0/2389718668 conn(0x7f88680fdc40 msgr2=0x7f8868100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.267+0000 7f886f800640 1 -- 172.21.15.7:0/2389718668 shutdown_connections 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.267+0000 7f886f800640 1 -- 172.21.15.7:0/2389718668 wait complete. 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.268+0000 7f886f800640 1 Processor -- start 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886f800640 1 -- start start 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8868102200 0x7f8868198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886f800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102bb0 0x7f8868198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886f800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8868107330 0x7f886819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886819d480 con 0x7f8868102200 2024-09-13T18:15:46.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886f800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886819d5f0 con 0x7f8868107330 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886f800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886819d760 con 0x7f8868102bb0 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8868102200 0x7f8868198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8868102200 0x7f8868198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54254/0 (socket says 172.21.15.7:54254) 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.269+0000 7f886ce00640 1 -- 172.21.15.7:0/3293321703 learned_addr learned my addr 172.21.15.7:0/3293321703 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f8867e00640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102bb0 0x7f8868198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f886d800640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8868107330 0x7f886819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f8867e00640 1 -- 172.21.15.7:0/3293321703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8868107330 msgr2=0x7f886819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f8867e00640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8868107330 0x7f886819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f8867e00640 1 -- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8868102200 msgr2=0x7f8868198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f8867e00640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8868102200 0x7f8868198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f8867e00640 1 -- 172.21.15.7:0/3293321703 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009560 con 0x7f8868102bb0 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f886ce00640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8868102200 0x7f8868198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:46.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.270+0000 7f8867e00640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102bb0 0x7f8868198a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8854005fd0 tx=0x7f885400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.271+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885400cd00 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.271+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f885400ce60 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.271+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854010430 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.271+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c009490 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.271+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88681a5130 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.273+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8868112230 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.275+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f88540035f0 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.276+0000 7f8865600640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f88500a1190 0x7f88500a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.277+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8854014070 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.277+0000 7f886ce00640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f88500a1190 0x7f88500a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.277+0000 7f8865600640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] conn(0x7f88500aa9e0 0x7f88500ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.277+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 --> [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88500ad4b0 con 0x7f88500aa9e0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.277+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88540d12c0 con 0x7f8868102bb0 2024-09-13T18:15:46.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.277+0000 7f886d800640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] conn(0x7f88500aa9e0 0x7f88500ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.277+0000 7f886ce00640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f88500a1190 0x7f88500a3650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f885c031000 tx=0x7f885c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.278+0000 7f886d800640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] conn(0x7f88500aa9e0 0x7f88500ace00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.279+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== osd.8 v2:172.21.15.116:6816/85007124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f88500ad4b0 con 0x7f88500aa9e0 2024-09-13T18:15:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.293+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 --> [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8868060b30 con 0x7f88500aa9e0 2024-09-13T18:15:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.294+0000 7f8865600640 1 -- 172.21.15.7:0/3293321703 <== osd.8 v2:172.21.15.116:6816/85007124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8868060b30 con 0x7f88500aa9e0 2024-09-13T18:15:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.294+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] conn(0x7f88500aa9e0 msgr2=0x7f88500ace00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:46.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.294+0000 7f886f800640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] conn(0x7f88500aa9e0 0x7f88500ace00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f88500a1190 msgr2=0x7f88500a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f88500a1190 0x7f88500a3650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f885c031000 tx=0x7f885c0056d0 comp rx=0 tx=0).stop 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102bb0 msgr2=0x7f8868198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 --2- 172.21.15.7:0/3293321703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8868102bb0 0x7f8868198a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8854005fd0 tx=0x7f885400ee50 comp rx=0 tx=0).stop 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886d800640 1 -- 172.21.15.7:0/3293321703 reap_dead start 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 shutdown_connections 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 >> 172.21.15.7:0/3293321703 conn(0x7f88680fdc40 msgr2=0x7f88680ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 shutdown_connections 2024-09-13T18:15:46.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:46.295+0000 7f886f800640 1 -- 172.21.15.7:0/3293321703 wait complete. 2024-09-13T18:15:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:46 smithi116 ceph-mon[35109]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:46.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:46 smithi007 ceph-mon[30588]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:46 smithi067 ceph-mon[35103]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:47.078 INFO:teuthology.orchestra.run.smithi007.stdout:77309411391 2024-09-13T18:15:47.078 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 -- 172.21.15.7:0/3991495390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc50101690 msgr2=0x7fdc50109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 --2- 172.21.15.7:0/3991495390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc50101690 0x7fdc50109b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009900 tx=0x7fdc3802a480 comp rx=0 tx=0).stop 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 -- 172.21.15.7:0/3991495390 shutdown_connections 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 --2- 172.21.15.7:0/3991495390 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc5010a1a0 0x7fdc5010c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 --2- 172.21.15.7:0/3991495390 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc50101690 0x7fdc50109b80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 --2- 172.21.15.7:0/3991495390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc50100d70 0x7fdc50101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 -- 172.21.15.7:0/3991495390 >> 172.21.15.7:0/3991495390 conn(0x7fdc500fa830 msgr2=0x7fdc500fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:47.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 -- 172.21.15.7:0/3991495390 shutdown_connections 2024-09-13T18:15:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.463+0000 7fdc55200640 1 -- 172.21.15.7:0/3991495390 wait complete. 2024-09-13T18:15:47.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 Processor -- start 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 -- start start 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc50100d70 0x7fdc500fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc50101690 0x7fdc500fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc5010a1a0 0x7fdc500ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50100970 con 0x7fdc5010a1a0 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc501a8a90 con 0x7fdc50100d70 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.464+0000 7fdc55200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc501a8c20 con 0x7fdc50101690 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc5010a1a0 0x7fdc500ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc50100d70 0x7fdc500fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:47.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc46a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc50101690 0x7fdc500fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc5010a1a0 0x7fdc500ff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54272/0 (socket says 172.21.15.7:54272) 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 -- 172.21.15.7:0/4153499334 learned_addr learned my addr 172.21.15.7:0/4153499334 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 -- 172.21.15.7:0/4153499334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc50101690 msgr2=0x7fdc500fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc50101690 0x7fdc500fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 -- 172.21.15.7:0/4153499334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc50100d70 msgr2=0x7fdc500fe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc50100d70 0x7fdc500fe9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 -- 172.21.15.7:0/4153499334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc38009560 con 0x7fdc5010a1a0 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc46a00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc50101690 0x7fdc500fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.465+0000 7fdc4fe00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc5010a1a0 0x7fdc500ff450 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800eb10 tx=0x7fdc4800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.466+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48004b20 con 0x7fdc5010a1a0 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.466+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc48004c80 con 0x7fdc5010a1a0 2024-09-13T18:15:47.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.466+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48010690 con 0x7fdc5010a1a0 2024-09-13T18:15:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.466+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc501a8f00 con 0x7fdc5010a1a0 2024-09-13T18:15:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.466+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc501a9320 con 0x7fdc5010a1a0 2024-09-13T18:15:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.467+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc5010ff10 con 0x7fdc5010a1a0 2024-09-13T18:15:47.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.469+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fdc48004fd0 con 0x7fdc5010a1a0 2024-09-13T18:15:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.470+0000 7fdc4cc00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdc340a1180 0x7fdc340a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:47.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.470+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdc48014070 con 0x7fdc5010a1a0 2024-09-13T18:15:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.470+0000 7fdc4f400640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdc340a1180 0x7fdc340a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.470+0000 7fdc4cc00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] conn(0x7fdc340aa9d0 0x7fdc340acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.470+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 --> [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc340ad4a0 con 0x7fdc340aa9d0 2024-09-13T18:15:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.470+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc480cd400 con 0x7fdc5010a1a0 2024-09-13T18:15:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.471+0000 7fdc46a00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] conn(0x7fdc340aa9d0 0x7fdc340acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.471+0000 7fdc4f400640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdc340a1180 0x7fdc340a3640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009bd0 tx=0x7fdc40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.471+0000 7fdc46a00640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] conn(0x7fdc340aa9d0 0x7fdc340acdf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:47.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.472+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== osd.0 v2:172.21.15.7:6802/1444921762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdc340ad4a0 con 0x7fdc340aa9d0 2024-09-13T18:15:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.486+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 --> [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc500687e0 con 0x7fdc340aa9d0 2024-09-13T18:15:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc4cc00640 1 -- 172.21.15.7:0/4153499334 <== osd.0 v2:172.21.15.7:6802/1444921762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc500687e0 con 0x7fdc340aa9d0 2024-09-13T18:15:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] conn(0x7fdc340aa9d0 msgr2=0x7fdc340acdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc55200640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] conn(0x7fdc340aa9d0 0x7fdc340acdf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdc340a1180 msgr2=0x7fdc340a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc55200640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdc340a1180 0x7fdc340a3640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009bd0 tx=0x7fdc40005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc5010a1a0 msgr2=0x7fdc500ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc55200640 1 --2- 172.21.15.7:0/4153499334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc5010a1a0 0x7fdc500ff450 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800eb10 tx=0x7fdc4800c2d0 comp rx=0 tx=0).stop 2024-09-13T18:15:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.487+0000 7fdc4fe00640 1 -- 172.21.15.7:0/4153499334 reap_dead start 2024-09-13T18:15:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.488+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 shutdown_connections 2024-09-13T18:15:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.488+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 >> 172.21.15.7:0/4153499334 conn(0x7fdc500fa830 msgr2=0x7fdc500fc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.488+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 shutdown_connections 2024-09-13T18:15:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:47.488+0000 7fdc55200640 1 -- 172.21.15.7:0/4153499334 wait complete. 2024-09-13T18:15:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 -- 172.21.15.7:0/2718810004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c10c460 msgr2=0x7f2d1c10e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 --2- 172.21.15.7:0/2718810004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c10c460 0x7f2d1c10e850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009ca0 tx=0x7f2d1402a950 comp rx=0 tx=0).stop 2024-09-13T18:15:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 -- 172.21.15.7:0/2718810004 shutdown_connections 2024-09-13T18:15:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 --2- 172.21.15.7:0/2718810004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c10c460 0x7f2d1c10e850 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 --2- 172.21.15.7:0/2718810004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d1c0731a0 0x7f2d1c10bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 --2- 172.21.15.7:0/2718810004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c072880 0x7f2d1c072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:48.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 -- 172.21.15.7:0/2718810004 >> 172.21.15.7:0/2718810004 conn(0x7f2d1c0fb900 msgr2=0x7f2d1c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 -- 172.21.15.7:0/2718810004 shutdown_connections 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.551+0000 7f2d21c00640 1 -- 172.21.15.7:0/2718810004 wait complete. 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.552+0000 7f2d21c00640 1 Processor -- start 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21c00640 1 -- start start 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c072880 0x7f2d1c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c0731a0 0x7f2d1c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d1c10c460 0x7f2d1c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c19d200 con 0x7f2d1c0731a0 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c19d370 con 0x7f2d1c10c460 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c19d4e0 con 0x7f2d1c072880 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d13400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c0731a0 0x7f2d1c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d1be00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c072880 0x7f2d1c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d13400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c0731a0 0x7f2d1c198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54286/0 (socket says 172.21.15.7:54286) 2024-09-13T18:15:48.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d13400640 1 -- 172.21.15.7:0/3753460051 learned_addr learned my addr 172.21.15.7:0/3753460051 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.553+0000 7f2d21200640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d1c10c460 0x7f2d1c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d13400640 1 -- 172.21.15.7:0/3753460051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c072880 msgr2=0x7f2d1c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d13400640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c072880 0x7f2d1c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d13400640 1 -- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d1c10c460 msgr2=0x7f2d1c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d13400640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d1c10c460 0x7f2d1c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d13400640 1 -- 172.21.15.7:0/3753460051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14009900 con 0x7f2d1c0731a0 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d1be00640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c072880 0x7f2d1c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d13400640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c0731a0 0x7f2d1c198850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400d950 tx=0x7f2d0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04009a30 con 0x7f2d1c0731a0 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d04009b90 con 0x7f2d1c0731a0 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040047a0 con 0x7f2d1c0731a0 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.554+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c19d7c0 con 0x7f2d1c0731a0 2024-09-13T18:15:48.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.555+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c1a5080 con 0x7f2d1c0731a0 2024-09-13T18:15:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.556+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d1c073f30 con 0x7f2d1c0731a0 2024-09-13T18:15:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.558+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f2d04009d00 con 0x7f2d1c0731a0 2024-09-13T18:15:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.559+0000 7f2d19600640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f2d000a1180 0x7f2d000a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:48.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.559+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2d040cc960 con 0x7f2d1c0731a0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.559+0000 7f2d1be00640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f2d000a1180 0x7f2d000a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.559+0000 7f2d19600640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] conn(0x7f2d000aa9d0 0x7f2d000acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.559+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 --> [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d000ad4a0 con 0x7f2d000aa9d0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.559+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d040cccd0 con 0x7f2d1c0731a0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.560+0000 7f2d21200640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] conn(0x7f2d000aa9d0 0x7f2d000acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.560+0000 7f2d1be00640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f2d000a1180 0x7f2d000a3640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009fc0 tx=0x7f2d0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.560+0000 7f2d21200640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] conn(0x7f2d000aa9d0 0x7f2d000acdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.561+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== osd.7 v2:172.21.15.67:6816/4066195090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2d000ad4a0 con 0x7f2d000aa9d0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.582+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 --> [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d1c060b30 con 0x7f2d000aa9d0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d19600640 1 -- 172.21.15.7:0/3753460051 <== osd.7 v2:172.21.15.67:6816/4066195090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2d1c060b30 con 0x7f2d000aa9d0 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] conn(0x7f2d000aa9d0 msgr2=0x7f2d000acdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] conn(0x7f2d000aa9d0 0x7f2d000acdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:48.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f2d000a1180 msgr2=0x7f2d000a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f2d000a1180 0x7f2d000a3640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009fc0 tx=0x7f2d0c005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c0731a0 msgr2=0x7f2d1c198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 --2- 172.21.15.7:0/3753460051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c0731a0 0x7f2d1c198850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400d950 tx=0x7f2d0400de10 comp rx=0 tx=0).stop 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21200640 1 -- 172.21.15.7:0/3753460051 reap_dead start 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 shutdown_connections 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 >> 172.21.15.7:0/3753460051 conn(0x7f2d1c0fb900 msgr2=0x7f2d1c0fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 shutdown_connections 2024-09-13T18:15:48.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:48.583+0000 7f2d21c00640 1 -- 172.21.15.7:0/3753460051 wait complete. 2024-09-13T18:15:48.724 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:48 smithi007 ceph-mon[30588]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-13T18:15:48.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:48 smithi116 ceph-mon[35109]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-13T18:15:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:48 smithi067 ceph-mon[35103]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-13T18:15:49.755 INFO:teuthology.orchestra.run.smithi007.stdout:257698037796 2024-09-13T18:15:49.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-13T18:15:50.435 INFO:teuthology.orchestra.run.smithi007.stdout:111669149754 2024-09-13T18:15:50.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T18:15:50.658 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:50 smithi007 ceph-mon[30588]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:50.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:50 smithi116 ceph-mon[35109]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:50 smithi067 ceph-mon[35103]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.223+0000 7f99d7200640 1 -- 172.21.15.7:0/2582152578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d01029e0 msgr2=0x7f99d0106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.223+0000 7f99d7200640 1 --2- 172.21.15.7:0/2582152578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d01029e0 0x7f99d0106a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009930 tx=0x7f99c002a420 comp rx=0 tx=0).stop 2024-09-13T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.223+0000 7f99d7200640 1 -- 172.21.15.7:0/2582152578 shutdown_connections 2024-09-13T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.223+0000 7f99d7200640 1 --2- 172.21.15.7:0/2582152578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99d0107160 0x7f99d010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.223+0000 7f99d7200640 1 --2- 172.21.15.7:0/2582152578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d01029e0 0x7f99d0106a30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.223+0000 7f99d7200640 1 --2- 172.21.15.7:0/2582152578 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99d0102030 0x7f99d0102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.223+0000 7f99d7200640 1 -- 172.21.15.7:0/2582152578 >> 172.21.15.7:0/2582152578 conn(0x7f99d00fda90 msgr2=0x7f99d00ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.224+0000 7f99d7200640 1 -- 172.21.15.7:0/2582152578 shutdown_connections 2024-09-13T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.224+0000 7f99d7200640 1 -- 172.21.15.7:0/2582152578 wait complete. 2024-09-13T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.224+0000 7f99d7200640 1 Processor -- start 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d7200640 1 -- start start 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d0102030 0x7f99d0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99d01029e0 0x7f99d0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d7200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99d0107160 0x7f99d019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019d270 con 0x7f99d0102030 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019d3e0 con 0x7f99d01029e0 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d7200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019d550 con 0x7f99d0107160 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d0102030 0x7f99d0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d0102030 0x7f99d0198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54306/0 (socket says 172.21.15.7:54306) 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d5e00640 1 -- 172.21.15.7:0/3412698981 learned_addr learned my addr 172.21.15.7:0/3412698981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d6800640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99d0107160 0x7f99d019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.225+0000 7f99d5400640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99d01029e0 0x7f99d0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d5e00640 1 -- 172.21.15.7:0/3412698981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99d0107160 msgr2=0x7f99d019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d5e00640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99d0107160 0x7f99d019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d5e00640 1 -- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99d01029e0 msgr2=0x7f99d0198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d5e00640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99d01029e0 0x7f99d0198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d5e00640 1 -- 172.21.15.7:0/3412698981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009560 con 0x7f99d0102030 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d5e00640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d0102030 0x7f99d0198330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99c400e9f0 tx=0x7f99c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4009700 con 0x7f99d0102030 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99c400cd80 con 0x7f99d0102030 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d019d830 con 0x7f99d0102030 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4018860 con 0x7f99d0102030 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.226+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d01a50f0 con 0x7f99d0102030 2024-09-13T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.227+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99d0112100 con 0x7f99d0102030 2024-09-13T18:15:51.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.229+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f99c40189c0 con 0x7f99d0102030 2024-09-13T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.231+0000 7f99caa00640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f99b80a1100 0x7f99b80a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.231+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f99c4014070 con 0x7f99d0102030 2024-09-13T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.231+0000 7f99d5400640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f99b80a1100 0x7f99b80a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.231+0000 7f99caa00640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] conn(0x7f99b80aa950 0x7f99b80acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.232+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 --> [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99b80ad420 con 0x7f99b80aa950 2024-09-13T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.232+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c40cd6d0 con 0x7f99d0102030 2024-09-13T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.232+0000 7f99d6800640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] conn(0x7f99b80aa950 0x7f99b80acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.232+0000 7f99d5400640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f99b80a1100 0x7f99b80a35c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f99c0031440 tx=0x7f99c0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.232+0000 7f99d6800640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] conn(0x7f99b80aa950 0x7f99b80acd70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.233+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== osd.10 v2:172.21.15.67:6824/782995716 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99b80ad420 con 0x7f99b80aa950 2024-09-13T18:15:51.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.247+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 --> [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99d0103510 con 0x7f99b80aa950 2024-09-13T18:15:51.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99caa00640 1 -- 172.21.15.7:0/3412698981 <== osd.10 v2:172.21.15.67:6824/782995716 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f99d0103510 con 0x7f99b80aa950 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] conn(0x7f99b80aa950 msgr2=0x7f99b80acd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99d7200640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] conn(0x7f99b80aa950 0x7f99b80acd70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f99b80a1100 msgr2=0x7f99b80a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99d7200640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f99b80a1100 0x7f99b80a35c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f99c0031440 tx=0x7f99c0005a20 comp rx=0 tx=0).stop 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d0102030 msgr2=0x7f99d0198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99d7200640 1 --2- 172.21.15.7:0/3412698981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99d0102030 0x7f99d0198330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99c400e9f0 tx=0x7f99c400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.248+0000 7f99d6800640 1 -- 172.21.15.7:0/3412698981 reap_dead start 2024-09-13T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.249+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 shutdown_connections 2024-09-13T18:15:51.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.249+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 >> 172.21.15.7:0/3412698981 conn(0x7f99d00fda90 msgr2=0x7f99d00fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:51.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.249+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 shutdown_connections 2024-09-13T18:15:51.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:51.249+0000 7f99d7200640 1 -- 172.21.15.7:0/3412698981 wait complete. 2024-09-13T18:15:52.506 INFO:teuthology.orchestra.run.smithi007.stdout:34359738442 2024-09-13T18:15:52.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T18:15:52.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:52 smithi007 ceph-mon[30588]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T18:15:52.872 INFO:teuthology.orchestra.run.smithi007.stdout:313532612633 2024-09-13T18:15:52.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-13T18:15:52.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:52 smithi116 ceph-mon[35109]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T18:15:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:52 smithi067 ceph-mon[35103]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-13T18:15:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 -- 172.21.15.7:0/545098019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40781029c0 msgr2=0x7f4078106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:53.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 --2- 172.21.15.7:0/545098019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40781029c0 0x7f4078106a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4060009890 tx=0x7f406002a360 comp rx=0 tx=0).stop 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 -- 172.21.15.7:0/545098019 shutdown_connections 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 --2- 172.21.15.7:0/545098019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4078107140 0x7f407810ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 --2- 172.21.15.7:0/545098019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40781029c0 0x7f4078106a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 --2- 172.21.15.7:0/545098019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4078102010 0x7f40781023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 -- 172.21.15.7:0/545098019 >> 172.21.15.7:0/545098019 conn(0x7f40780fda70 msgr2=0x7f40780ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 -- 172.21.15.7:0/545098019 shutdown_connections 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.210+0000 7f407cc00640 1 -- 172.21.15.7:0/545098019 wait complete. 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 Processor -- start 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 -- start start 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4078102010 0x7f4078198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:53.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40781029c0 0x7f4078198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4078107140 0x7f407819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407819d260 con 0x7f4078102010 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407819d3d0 con 0x7f4078107140 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.211+0000 7f407cc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407819d540 con 0x7f40781029c0 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4078102010 0x7f4078198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4078107140 0x7f407819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4078102010 0x7f4078198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54330/0 (socket says 172.21.15.7:54330) 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077400640 1 -- 172.21.15.7:0/1542572128 learned_addr learned my addr 172.21.15.7:0/1542572128 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f406ea00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40781029c0 0x7f4078198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077e00640 1 -- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40781029c0 msgr2=0x7f4078198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077e00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40781029c0 0x7f4078198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:53.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077e00640 1 -- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4078102010 msgr2=0x7f4078198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077e00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4078102010 0x7f4078198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077e00640 1 -- 172.21.15.7:0/1542572128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068009490 con 0x7f4078107140 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077400640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4078102010 0x7f4078198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4077e00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4078107140 0x7f407819cc60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f407000efc0 tx=0x7f407000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.212+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070003970 con 0x7f4078107140 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.213+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4070004020 con 0x7f4078107140 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.213+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4070009900 con 0x7f4078107140 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.213+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407000b850 con 0x7f4078107140 2024-09-13T18:15:53.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.213+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4060009490 con 0x7f4078107140 2024-09-13T18:15:53.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.214+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4078112050 con 0x7f4078107140 2024-09-13T18:15:53.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.216+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f407000a040 con 0x7f4078107140 2024-09-13T18:15:53.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.217+0000 7f4074c00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f405c0a1180 0x7f405c0a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:53.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.217+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f40700ccac0 con 0x7f4078107140 2024-09-13T18:15:53.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.217+0000 7f4077400640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f405c0a1180 0x7f405c0a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:53.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.217+0000 7f4074c00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] conn(0x7f405c0aa9d0 0x7f405c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:53.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.217+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 --> [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f405c0ad4a0 con 0x7f405c0aa9d0 2024-09-13T18:15:53.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.217+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40700d12a0 con 0x7f4078107140 2024-09-13T18:15:53.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.218+0000 7f406ea00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] conn(0x7f405c0aa9d0 0x7f405c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:53.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.218+0000 7f4077400640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f405c0a1180 0x7f405c0a3640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4068011690 tx=0x7f4068005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:53.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.218+0000 7f406ea00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] conn(0x7f405c0aa9d0 0x7f405c0acdf0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:53.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.220+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== osd.11 v2:172.21.15.116:6824/3892290282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f405c0ad4a0 con 0x7f405c0aa9d0 2024-09-13T18:15:53.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.234+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 --> [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40781034f0 con 0x7f405c0aa9d0 2024-09-13T18:15:53.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.234+0000 7f4074c00640 1 -- 172.21.15.7:0/1542572128 <== osd.11 v2:172.21.15.116:6824/3892290282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f40781034f0 con 0x7f405c0aa9d0 2024-09-13T18:15:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] conn(0x7f405c0aa9d0 msgr2=0x7f405c0acdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] conn(0x7f405c0aa9d0 0x7f405c0acdf0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f405c0a1180 msgr2=0x7f405c0a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f405c0a1180 0x7f405c0a3640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4068011690 tx=0x7f4068005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:53.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4078107140 msgr2=0x7f407819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 --2- 172.21.15.7:0/1542572128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4078107140 0x7f407819cc60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f407000efc0 tx=0x7f407000c800 comp rx=0 tx=0).stop 2024-09-13T18:15:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f4077e00640 1 -- 172.21.15.7:0/1542572128 reap_dead start 2024-09-13T18:15:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 shutdown_connections 2024-09-13T18:15:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 >> 172.21.15.7:0/1542572128 conn(0x7f40780fda70 msgr2=0x7f40780fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 shutdown_connections 2024-09-13T18:15:53.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:53.235+0000 7f407cc00640 1 -- 172.21.15.7:0/1542572128 wait complete. 2024-09-13T18:15:54.170 INFO:teuthology.orchestra.run.smithi007.stdout:347892350999 2024-09-13T18:15:54.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-13T18:15:54.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.376+0000 7f8e8d200640 1 -- 172.21.15.7:0/1717964165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e88102200 msgr2=0x7f8e881025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:54.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.376+0000 7f8e8d200640 1 --2- 172.21.15.7:0/1717964165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e88102200 0x7f8e881025e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009900 tx=0x7f8e7802a410 comp rx=0 tx=0).stop 2024-09-13T18:15:54.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.377+0000 7f8e8d200640 1 -- 172.21.15.7:0/1717964165 shutdown_connections 2024-09-13T18:15:54.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.377+0000 7f8e8d200640 1 --2- 172.21.15.7:0/1717964165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e88107330 0x7f8e8810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:54.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.377+0000 7f8e8d200640 1 --2- 172.21.15.7:0/1717964165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e88102bb0 0x7f8e88106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:54.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.377+0000 7f8e8d200640 1 --2- 172.21.15.7:0/1717964165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e88102200 0x7f8e881025e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:54.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.377+0000 7f8e8d200640 1 -- 172.21.15.7:0/1717964165 >> 172.21.15.7:0/1717964165 conn(0x7f8e880fdc60 msgr2=0x7f8e88100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:54.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.377+0000 7f8e8d200640 1 -- 172.21.15.7:0/1717964165 shutdown_connections 2024-09-13T18:15:54.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.377+0000 7f8e8d200640 1 -- 172.21.15.7:0/1717964165 wait complete. 2024-09-13T18:15:54.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 Processor -- start 2024-09-13T18:15:54.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 -- start start 2024-09-13T18:15:54.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e88102200 0x7f8e881984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:54.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e88102bb0 0x7f8e881989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:54.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e88107330 0x7f8e8819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:54.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8819d3e0 con 0x7f8e88102200 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8819d550 con 0x7f8e88102bb0 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.379+0000 7f8e8d200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8819d6c0 con 0x7f8e88107330 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e88102bb0 0x7f8e881989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e88102bb0 0x7f8e881989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:44686/0 (socket says 172.21.15.7:44686) 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 -- 172.21.15.7:0/3935224453 learned_addr learned my addr 172.21.15.7:0/3935224453 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e86800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e88107330 0x7f8e8819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85e00640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e88102200 0x7f8e881984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 -- 172.21.15.7:0/3935224453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e88107330 msgr2=0x7f8e8819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e88107330 0x7f8e8819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 -- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e88102200 msgr2=0x7f8e881984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e88102200 0x7f8e881984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85400640 1 -- 172.21.15.7:0/3935224453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e78009560 con 0x7f8e88102bb0 2024-09-13T18:15:54.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.380+0000 7f8e85e00640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e88102200 0x7f8e881984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:15:54.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.381+0000 7f8e85400640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e88102bb0 0x7f8e881989e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d950 tx=0x7f8e7400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:54.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.381+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74009a30 con 0x7f8e88102bb0 2024-09-13T18:15:54.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.381+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e74009b90 con 0x7f8e88102bb0 2024-09-13T18:15:54.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.381+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8819d9a0 con 0x7f8e88102bb0 2024-09-13T18:15:54.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.381+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e740047a0 con 0x7f8e88102bb0 2024-09-13T18:15:54.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.381+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e881a5260 con 0x7f8e88102bb0 2024-09-13T18:15:54.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.382+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e88112270 con 0x7f8e88102bb0 2024-09-13T18:15:54.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.384+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f8e74004020 con 0x7f8e88102bb0 2024-09-13T18:15:54.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.385+0000 7f8e7ea00640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e6c0a1190 0x7f8e6c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:54.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.385+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8e740cc570 con 0x7f8e88102bb0 2024-09-13T18:15:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.386+0000 7f8e85e00640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e6c0a1190 0x7f8e6c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.386+0000 7f8e7ea00640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] conn(0x7f8e6c0aa9e0 0x7f8e6c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.386+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 --> [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e6c0ad4b0 con 0x7f8e6c0aa9e0 2024-09-13T18:15:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.386+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e740cc8e0 con 0x7f8e88102bb0 2024-09-13T18:15:54.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.386+0000 7f8e86800640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] conn(0x7f8e6c0aa9e0 0x7f8e6c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:54.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.386+0000 7f8e85e00640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e6c0a1190 0x7f8e6c0a3650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e78005ab0 tx=0x7f8e78005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:54.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.387+0000 7f8e86800640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] conn(0x7f8e6c0aa9e0 0x7f8e6c0ace00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:54.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.388+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== osd.5 v2:172.21.15.116:6808/1272520856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8e6c0ad4b0 con 0x7f8e6c0aa9e0 2024-09-13T18:15:54.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.402+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 --> [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e88060b30 con 0x7f8e6c0aa9e0 2024-09-13T18:15:54.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e7ea00640 1 -- 172.21.15.7:0/3935224453 <== osd.5 v2:172.21.15.116:6808/1272520856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8e88060b30 con 0x7f8e6c0aa9e0 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 >> [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] conn(0x7f8e6c0aa9e0 msgr2=0x7f8e6c0ace00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] conn(0x7f8e6c0aa9e0 0x7f8e6c0ace00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e6c0a1190 msgr2=0x7f8e6c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8e6c0a1190 0x7f8e6c0a3650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e78005ab0 tx=0x7f8e78005a20 comp rx=0 tx=0).stop 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e88102bb0 msgr2=0x7f8e881989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 --2- 172.21.15.7:0/3935224453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e88102bb0 0x7f8e881989e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d950 tx=0x7f8e7400de10 comp rx=0 tx=0).stop 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e86800640 1 -- 172.21.15.7:0/3935224453 reap_dead start 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 shutdown_connections 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 >> 172.21.15.7:0/3935224453 conn(0x7f8e880fdc60 msgr2=0x7f8e880ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.403+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 shutdown_connections 2024-09-13T18:15:54.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:54.404+0000 7f8e8d200640 1 -- 172.21.15.7:0/3935224453 wait complete. 2024-09-13T18:15:54.649 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:54 smithi007 ceph-mon[30588]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-13T18:15:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:54 smithi116 ceph-mon[35109]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-13T18:15:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:54 smithi067 ceph-mon[35103]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-13T18:15:55.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 -- 172.21.15.7:0/4093098784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524107330 msgr2=0x7fd52410eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 --2- 172.21.15.7:0/4093098784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524107330 0x7fd52410eeb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009cd0 tx=0x7fd51c02a8e0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 -- 172.21.15.7:0/4093098784 shutdown_connections 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 --2- 172.21.15.7:0/4093098784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524107330 0x7fd52410eeb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 --2- 172.21.15.7:0/4093098784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd524102bb0 0x7fd524106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 --2- 172.21.15.7:0/4093098784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd524102200 0x7fd5241025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 -- 172.21.15.7:0/4093098784 >> 172.21.15.7:0/4093098784 conn(0x7fd5240fdc60 msgr2=0x7fd524100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 -- 172.21.15.7:0/4093098784 shutdown_connections 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.034+0000 7fd529a00640 1 -- 172.21.15.7:0/4093098784 wait complete. 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.035+0000 7fd529a00640 1 Processor -- start 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.035+0000 7fd529a00640 1 -- start start 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd529a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524102200 0x7fd5241984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:55.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd529a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd524102bb0 0x7fd5241989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd529a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd524107330 0x7fd52419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd529a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52419d3f0 con 0x7fd524102200 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd529a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52419d560 con 0x7fd524102bb0 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd529a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52419d6d0 con 0x7fd524107330 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524102200 0x7fd5241984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524102200 0x7fd5241984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59964/0 (socket says 172.21.15.7:59964) 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 -- 172.21.15.7:0/892442965 learned_addr learned my addr 172.21.15.7:0/892442965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd523400640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd524107330 0x7fd52419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522000640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd524102bb0 0x7fd5241989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 -- 172.21.15.7:0/892442965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd524107330 msgr2=0x7fd52419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd524107330 0x7fd52419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 -- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd524102bb0 msgr2=0x7fd5241989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:55.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd524102bb0 0x7fd5241989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.036+0000 7fd522a00640 1 -- 172.21.15.7:0/892442965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c009900 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.037+0000 7fd522a00640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524102200 0x7fd5241984b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd51400e9f0 tx=0x7fd51400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.037+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514009720 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.037+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd51400cd80 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.037+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52419d9b0 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.037+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514010430 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.037+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5241a5270 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.038+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5241036e0 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.040+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fd514005000 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.041+0000 7fd51b400640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd5080a1190 0x7fd5080a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.041+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd514014070 con 0x7fd524102200 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.041+0000 7fd522000640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd5080a1190 0x7fd5080a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:55.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.041+0000 7fd51b400640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] conn(0x7fd5080aa9e0 0x7fd5080ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:15:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.041+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 --> [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5080ad4b0 con 0x7fd5080aa9e0 2024-09-13T18:15:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.041+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5140cd2e0 con 0x7fd524102200 2024-09-13T18:15:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.042+0000 7fd523400640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] conn(0x7fd5080aa9e0 0x7fd5080ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:15:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.042+0000 7fd522000640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd5080a1190 0x7fd5080a3650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd524199a60 tx=0x7fd510005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.042+0000 7fd523400640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] conn(0x7fd5080aa9e0 0x7fd5080ace00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:15:55.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.043+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== osd.4 v2:172.21.15.67:6808/570234379 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd5080ad4b0 con 0x7fd5080aa9e0 2024-09-13T18:15:55.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.057+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 --> [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd524112300 con 0x7fd5080aa9e0 2024-09-13T18:15:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd51b400640 1 -- 172.21.15.7:0/892442965 <== osd.4 v2:172.21.15.67:6808/570234379 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd51c030bd0 con 0x7fd5080aa9e0 2024-09-13T18:15:55.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] conn(0x7fd5080aa9e0 msgr2=0x7fd5080ace00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd529a00640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] conn(0x7fd5080aa9e0 0x7fd5080ace00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd5080a1190 msgr2=0x7fd5080a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd529a00640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd5080a1190 0x7fd5080a3650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd524199a60 tx=0x7fd510005f90 comp rx=0 tx=0).stop 2024-09-13T18:15:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524102200 msgr2=0x7fd5241984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:15:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd529a00640 1 --2- 172.21.15.7:0/892442965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd524102200 0x7fd5241984b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd51400e9f0 tx=0x7fd51400edf0 comp rx=0 tx=0).stop 2024-09-13T18:15:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.058+0000 7fd523400640 1 -- 172.21.15.7:0/892442965 reap_dead start 2024-09-13T18:15:55.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.059+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 shutdown_connections 2024-09-13T18:15:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.059+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 >> 172.21.15.7:0/892442965 conn(0x7fd5240fdc60 msgr2=0x7fd5240ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:15:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.059+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 shutdown_connections 2024-09-13T18:15:55.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:15:55.059+0000 7fd529a00640 1 -- 172.21.15.7:0/892442965 wait complete. 2024-09-13T18:15:56.114 INFO:teuthology.orchestra.run.smithi007.stdout:223338299432 2024-09-13T18:15:56.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-13T18:15:56.785 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:56.785 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:56.787 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:56.788 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:56.788 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:56.791 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:56.809 INFO:teuthology.orchestra.run.smithi007.stdout:167503724597 2024-09-13T18:15:56.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T18:15:56.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:56 smithi007 ceph-mon[30588]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-13T18:15:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:56 smithi116 ceph-mon[35109]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-13T18:15:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:56 smithi067 ceph-mon[35103]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-13T18:15:57.216 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:57.231 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:57.243 INFO:teuthology.orchestra.run.smithi007.stdout:146028888120 2024-09-13T18:15:57.243 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T18:15:57.394 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:15:58.718 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:15:58 smithi007 ceph-mon[30588]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:15:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:15:58 smithi116 ceph-mon[35109]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:15:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:15:58 smithi067 ceph-mon[35103]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:00.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:00 smithi007 ceph-mon[30588]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:16:00.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:00 smithi116 ceph-mon[35109]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:16:00.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:00 smithi067 ceph-mon[35103]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:16:02.696 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:02 smithi007 ceph-mon[30588]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:16:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:02 smithi116 ceph-mon[35109]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:16:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:02 smithi067 ceph-mon[35103]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:16:04.693 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:04 smithi007 ceph-mon[30588]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:04 smithi116 ceph-mon[35109]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:04 smithi067 ceph-mon[35103]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:06.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:06 smithi007 ceph-mon[30588]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:06.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:06 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:16:06.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:06 smithi116 ceph-mon[35109]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:06.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:06 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:16:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:06 smithi067 ceph-mon[35103]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:06.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:06 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:16:07.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.261+0000 7f5a62c00640 1 -- 172.21.15.7:0/90068779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 msgr2=0x7f5a5c10c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.261+0000 7f5a62c00640 1 --2- 172.21.15.7:0/90068779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 0x7f5a5c10c800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009ca0 tx=0x7f5a5402a950 comp rx=0 tx=0).stop 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.261+0000 7f5a62c00640 1 -- 172.21.15.7:0/90068779 shutdown_connections 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.261+0000 7f5a62c00640 1 --2- 172.21.15.7:0/90068779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 0x7f5a5c10c800 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.261+0000 7f5a62c00640 1 --2- 172.21.15.7:0/90068779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a5c101850 0x7f5a5c109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.261+0000 7f5a62c00640 1 --2- 172.21.15.7:0/90068779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 0x7f5a5c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.261+0000 7f5a62c00640 1 -- 172.21.15.7:0/90068779 >> 172.21.15.7:0/90068779 conn(0x7f5a5c0fa9b0 msgr2=0x7f5a5c0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.262+0000 7f5a62c00640 1 -- 172.21.15.7:0/90068779 shutdown_connections 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.262+0000 7f5a62c00640 1 -- 172.21.15.7:0/90068779 wait complete. 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.263+0000 7f5a62c00640 1 Processor -- start 2024-09-13T18:16:07.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a62c00640 1 -- start start 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a62c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 0x7f5a5c0feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a62c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a5c101850 0x7f5a5c0ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a62c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 0x7f5a5c0ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a62c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1a4580 con 0x7f5a5c10a360 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a62c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1a46f0 con 0x7f5a5c101850 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a62c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1a48b0 con 0x7f5a5c100f30 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a5be00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 0x7f5a5c0feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a5b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a5c101850 0x7f5a5c0ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a5be00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 0x7f5a5c0feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:53776/0 (socket says 172.21.15.7:53776) 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a5be00640 1 -- 172.21.15.7:0/2094999894 learned_addr learned my addr 172.21.15.7:0/2094999894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.264+0000 7f5a60c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 0x7f5a5c0ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a5be00640 1 -- 172.21.15.7:0/2094999894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a5c101850 msgr2=0x7f5a5c0ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a5be00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a5c101850 0x7f5a5c0ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a5be00640 1 -- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 msgr2=0x7f5a5c0ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a5be00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 0x7f5a5c0ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a5be00640 1 -- 172.21.15.7:0/2094999894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54009900 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a60c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 0x7f5a5c0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a5be00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 0x7f5a5c0feb90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00e9f0 tx=0x7f5a4c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a58c00640 1 -- 172.21.15.7:0/2094999894 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c009720 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a58c00640 1 -- 172.21.15.7:0/2094999894 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a4c00cd80 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a58c00640 1 -- 172.21.15.7:0/2094999894 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c010430 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.265+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c1a4b90 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.266+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c1a5040 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.267+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c0687e0 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.270+0000 7f5a58c00640 1 -- 172.21.15.7:0/2094999894 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f5a4c005020 con 0x7f5a5c100f30 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.272+0000 7f5a58c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5a400a1110 0x7f5a400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.272+0000 7f5a58c00640 1 -- 172.21.15.7:0/2094999894 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5a4c014070 con 0x7f5a5c100f30 2024-09-13T18:16:07.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.272+0000 7f5a5b400640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5a400a1110 0x7f5a400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.273+0000 7f5a5b400640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5a400a1110 0x7f5a400a35d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c100310 tx=0x7f5a48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:07.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.275+0000 7f5a58c00640 1 -- 172.21.15.7:0/2094999894 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5a4c096560 con 0x7f5a5c100f30 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.382+0000 7f90d6c00640 1 -- 172.21.15.7:0/3041761545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0102200 msgr2=0x7f90d01025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.382+0000 7f90d6c00640 1 --2- 172.21.15.7:0/3041761545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0102200 0x7f90d01025e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009900 tx=0x7f90c002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.383+0000 7f90d6c00640 1 -- 172.21.15.7:0/3041761545 shutdown_connections 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.383+0000 7f90d6c00640 1 --2- 172.21.15.7:0/3041761545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0107330 0x7f90d010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.383+0000 7f90d6c00640 1 --2- 172.21.15.7:0/3041761545 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d0102bb0 0x7f90d0106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.383+0000 7f90d6c00640 1 --2- 172.21.15.7:0/3041761545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0102200 0x7f90d01025e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.383+0000 7f90d6c00640 1 -- 172.21.15.7:0/3041761545 >> 172.21.15.7:0/3041761545 conn(0x7f90d00fdc60 msgr2=0x7f90d0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.383+0000 7f90d6c00640 1 -- 172.21.15.7:0/3041761545 shutdown_connections 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.383+0000 7f90d6c00640 1 -- 172.21.15.7:0/3041761545 wait complete. 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 Processor -- start 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 -- start start 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d0102200 0x7f90d0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0102bb0 0x7f90d0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0107330 0x7f90d019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d019d460 con 0x7f90d0102bb0 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d019d5d0 con 0x7f90d0102200 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90d6c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d019d740 con 0x7f90d0107330 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0102bb0 0x7f90d0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0102bb0 0x7f90d0198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42370/0 (socket says 172.21.15.7:42370) 2024-09-13T18:16:07.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.384+0000 7f90cf400640 1 -- 172.21.15.7:0/392824582 learned_addr learned my addr 172.21.15.7:0/392824582 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90cfe00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d0102200 0x7f90d0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d4c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0107330 0x7f90d019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d4c00640 1 -- 172.21.15.7:0/392824582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d0102200 msgr2=0x7f90d0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d4c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d0102200 0x7f90d0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d4c00640 1 -- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0102bb0 msgr2=0x7f90d0198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d4c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0102bb0 0x7f90d0198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d4c00640 1 -- 172.21.15.7:0/392824582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009490 con 0x7f90d0107330 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90cf400640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0102bb0 0x7f90d0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d4c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0107330 0x7f90d019ce60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009fd0 tx=0x7f90c800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90ccc00640 1 -- 172.21.15.7:0/392824582 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c800ce20 con 0x7f90d0107330 2024-09-13T18:16:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90ccc00640 1 -- 172.21.15.7:0/392824582 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90c8005020 con 0x7f90d0107330 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.385+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c0009560 con 0x7f90d0107330 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.386+0000 7f90ccc00640 1 -- 172.21.15.7:0/392824582 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8010670 con 0x7f90d0107330 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.386+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d01a5110 con 0x7f90d0107330 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.387+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d01036e0 con 0x7f90d0107330 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.389+0000 7f90ccc00640 1 -- 172.21.15.7:0/392824582 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f90c8005450 con 0x7f90d0107330 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.390+0000 7f90ccc00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f90b40a1110 0x7f90b40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.390+0000 7f90ccc00640 1 -- 172.21.15.7:0/392824582 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f90c8014070 con 0x7f90d0107330 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.390+0000 7f90cfe00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f90b40a1110 0x7f90b40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.391+0000 7f90cfe00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f90b40a1110 0x7f90b40a35d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000c00 tx=0x7f90c0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:07.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.394+0000 7f90ccc00640 1 -- 172.21.15.7:0/392824582 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f90c8096730 con 0x7f90d0107330 2024-09-13T18:16:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.485+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a5c105400 con 0x7f5a5c100f30 2024-09-13T18:16:07.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.486+0000 7f5a58c00640 1 -- 172.21.15.7:0/2094999894 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a4c099b80 con 0x7f5a5c100f30 2024-09-13T18:16:07.490 INFO:teuthology.orchestra.run.smithi007.stdout:55834574921 2024-09-13T18:16:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5a400a1110 msgr2=0x7f5a400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5a400a1110 0x7f5a400a35d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c100310 tx=0x7f5a48005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 msgr2=0x7f5a5c0feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 0x7f5a5c0feb90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00e9f0 tx=0x7f5a4c00edf0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 shutdown_connections 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5a400a1110 0x7f5a400a35d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5a5c10a360 0x7f5a5c0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a5c101850 0x7f5a5c0ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 --2- 172.21.15.7:0/2094999894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a5c100f30 0x7f5a5c0feb90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 >> 172.21.15.7:0/2094999894 conn(0x7f5a5c0fa9b0 msgr2=0x7f5a5c0fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 shutdown_connections 2024-09-13T18:16:07.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.490+0000 7f5a62c00640 1 -- 172.21.15.7:0/2094999894 wait complete. 2024-09-13T18:16:07.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.583+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f90d01025e0 con 0x7f90d0107330 2024-09-13T18:16:07.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.583+0000 7f90ccc00640 1 -- 172.21.15.7:0/392824582 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90c8099d50 con 0x7f90d0107330 2024-09-13T18:16:07.587 INFO:teuthology.orchestra.run.smithi007.stdout:292057776162 2024-09-13T18:16:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f90b40a1110 msgr2=0x7f90b40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f90b40a1110 0x7f90b40a35d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000c00 tx=0x7f90c0005e80 comp rx=0 tx=0).stop 2024-09-13T18:16:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0107330 msgr2=0x7f90d019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0107330 0x7f90d019ce60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009fd0 tx=0x7f90c800ef10 comp rx=0 tx=0).stop 2024-09-13T18:16:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 shutdown_connections 2024-09-13T18:16:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f90b40a1110 0x7f90b40a35d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90d0107330 0x7f90d019ce60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90d0102bb0 0x7f90d0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 --2- 172.21.15.7:0/392824582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90d0102200 0x7f90d0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 >> 172.21.15.7:0/392824582 conn(0x7f90d00fdc60 msgr2=0x7f90d00ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.585+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 shutdown_connections 2024-09-13T18:16:07.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:07.586+0000 7f90d6c00640 1 -- 172.21.15.7:0/392824582 wait complete. 2024-09-13T18:16:07.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2094999894' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:16:07.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/392824582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T18:16:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2094999894' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:16:07.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/392824582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T18:16:07.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2094999894' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:16:07.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/392824582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T18:16:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.130+0000 7fcfa4c00640 1 -- 172.21.15.7:0/2643252035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 msgr2=0x7fcfa0109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.130+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/2643252035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 0x7fcfa0109d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009900 tx=0x7fcf8802a400 comp rx=0 tx=0).stop 2024-09-13T18:16:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.131+0000 7fcfa4c00640 1 -- 172.21.15.7:0/2643252035 shutdown_connections 2024-09-13T18:16:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.131+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/2643252035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa010a3d0 0x7fcfa010c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.131+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/2643252035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 0x7fcfa0109d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.131+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/2643252035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 0x7fcfa0101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.131+0000 7fcfa4c00640 1 -- 172.21.15.7:0/2643252035 >> 172.21.15.7:0/2643252035 conn(0x7fcfa00fa9b0 msgr2=0x7fcfa00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:08.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.131+0000 7fcfa4c00640 1 -- 172.21.15.7:0/2643252035 shutdown_connections 2024-09-13T18:16:08.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.131+0000 7fcfa4c00640 1 -- 172.21.15.7:0/2643252035 wait complete. 2024-09-13T18:16:08.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 Processor -- start 2024-09-13T18:16:08.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 -- start start 2024-09-13T18:16:08.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 0x7fcfa0196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:08.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 0x7fcfa01967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa010a3d0 0x7fcfa019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa019b1d0 con 0x7fcfa010a3d0 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa019b340 con 0x7fcfa0101870 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcfa4c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa019b4b0 con 0x7fcfa0100f50 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcf97e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 0x7fcfa01967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcf9de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 0x7fcfa0196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcf9e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa010a3d0 0x7fcfa019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcf97e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 0x7fcfa01967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:33174/0 (socket says 172.21.15.7:33174) 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcf97e00640 1 -- 172.21.15.7:0/605668305 learned_addr learned my addr 172.21.15.7:0/605668305 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.132+0000 7fcf9de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 0x7fcfa0196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:53820/0 (socket says 172.21.15.7:53820) 2024-09-13T18:16:08.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.133+0000 7fcf9de00640 1 -- 172.21.15.7:0/605668305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 msgr2=0x7fcfa01967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:08.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.133+0000 7fcf9de00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 0x7fcfa01967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.133+0000 7fcf9de00640 1 -- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa010a3d0 msgr2=0x7fcfa019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:08.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.133+0000 7fcf9de00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa010a3d0 0x7fcfa019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.133+0000 7fcf9de00640 1 -- 172.21.15.7:0/605668305 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009840 con 0x7fcfa0100f50 2024-09-13T18:16:08.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.133+0000 7fcf9de00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 0x7fcfa0196290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000e9f0 tx=0x7fcf9000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.133+0000 7fcf96a00640 1 -- 172.21.15.7:0/605668305 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90009640 con 0x7fcfa0100f50 2024-09-13T18:16:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.134+0000 7fcf96a00640 1 -- 172.21.15.7:0/605668305 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf9000ccc0 con 0x7fcfa0100f50 2024-09-13T18:16:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.134+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf88009560 con 0x7fcfa0100f50 2024-09-13T18:16:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.134+0000 7fcf96a00640 1 -- 172.21.15.7:0/605668305 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90018640 con 0x7fcfa0100f50 2024-09-13T18:16:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.134+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa01a2e80 con 0x7fcfa0100f50 2024-09-13T18:16:08.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.135+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa0069000 con 0x7fcfa0100f50 2024-09-13T18:16:08.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.137+0000 7fcf96a00640 1 -- 172.21.15.7:0/605668305 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fcf90005030 con 0x7fcfa0100f50 2024-09-13T18:16:08.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.138+0000 7fcf96a00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fcf840a1190 0x7fcf840a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:08.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.138+0000 7fcf96a00640 1 -- 172.21.15.7:0/605668305 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcf90014070 con 0x7fcfa0100f50 2024-09-13T18:16:08.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.138+0000 7fcf97e00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fcf840a1190 0x7fcf840a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:08.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.139+0000 7fcf97e00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fcf840a1190 0x7fcf840a3650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf88005ec0 tx=0x7fcf880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:08.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.140+0000 7fcf96a00640 1 -- 172.21.15.7:0/605668305 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf900962b0 con 0x7fcfa0100f50 2024-09-13T18:16:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.365+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fcfa0101330 con 0x7fcfa0100f50 2024-09-13T18:16:08.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.365+0000 7fcf96a00640 1 -- 172.21.15.7:0/605668305 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fcf900998d0 con 0x7fcfa0100f50 2024-09-13T18:16:08.369 INFO:teuthology.orchestra.run.smithi007.stdout:347892351002 2024-09-13T18:16:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fcf840a1190 msgr2=0x7fcf840a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fcf840a1190 0x7fcf840a3650 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf88005ec0 tx=0x7fcf880058d0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 msgr2=0x7fcfa0196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 0x7fcfa0196290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000e9f0 tx=0x7fcf9000edf0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 shutdown_connections 2024-09-13T18:16:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fcf840a1190 0x7fcf840a3650 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcfa010a3d0 0x7fcfa019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfa0101870 0x7fcfa01967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 --2- 172.21.15.7:0/605668305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcfa0100f50 0x7fcfa0196290 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 >> 172.21.15.7:0/605668305 conn(0x7fcfa00fa9b0 msgr2=0x7fcfa00fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 shutdown_connections 2024-09-13T18:16:08.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:08.368+0000 7fcfa4c00640 1 -- 172.21.15.7:0/605668305 wait complete. 2024-09-13T18:16:09.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/605668305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-13T18:16:09.269 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:09 smithi007 ceph-mon[30588]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:09.295 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574915 got 55834574921 for osd.1 2024-09-13T18:16:09.295 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/605668305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-13T18:16:09.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-13T18:16:09.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-13T18:16:09.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-13T18:16:09.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-13T18:16:09.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-13T18:16:09.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-13T18:16:09.462 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:09 smithi116 ceph-mon[35109]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/605668305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T18:16:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-13T18:16:09.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-13T18:16:09.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-13T18:16:09.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-13T18:16:09.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-13T18:16:09.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-13T18:16:09.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-13T18:16:09.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-13T18:16:09.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:09 smithi067 ceph-mon[35103]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:10.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-13T18:16:10.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:10 smithi007 ceph-mon[30588]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T18:16:10.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-13T18:16:10.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:10 smithi116 ceph-mon[35109]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T18:16:10.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-13T18:16:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-13T18:16:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-13T18:16:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-13T18:16:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-13T18:16:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-13T18:16:10.498 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-13T18:16:10.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-13T18:16:10.499 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:10 smithi067 ceph-mon[35103]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T18:16:10.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 -- 172.21.15.7:0/3760909435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080072850 msgr2=0x7fa080072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:10.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 --2- 172.21.15.7:0/3760909435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080072850 0x7fa080072c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa070009900 tx=0x7fa07002a480 comp rx=0 tx=0).stop 2024-09-13T18:16:10.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 -- 172.21.15.7:0/3760909435 shutdown_connections 2024-09-13T18:16:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 --2- 172.21.15.7:0/3760909435 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa080110d90 0x7fa080113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 --2- 172.21.15.7:0/3760909435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa080073170 0x7fa080110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 --2- 172.21.15.7:0/3760909435 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080072850 0x7fa080072c30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 -- 172.21.15.7:0/3760909435 >> 172.21.15.7:0/3760909435 conn(0x7fa0800fbae0 msgr2=0x7fa0800fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.777+0000 7fa085800640 1 -- 172.21.15.7:0/3760909435 shutdown_connections 2024-09-13T18:16:10.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.778+0000 7fa085800640 1 -- 172.21.15.7:0/3760909435 wait complete. 2024-09-13T18:16:10.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 Processor -- start 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 -- start start 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa080072850 0x7fa0801a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa080073170 0x7fa0801a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080110d90 0x7fa08019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08019cf00 con 0x7fa080110d90 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08019d070 con 0x7fa080072850 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.779+0000 7fa085800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08019d230 con 0x7fa080073170 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080110d90 0x7fa08019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa080072850 0x7fa0801a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080110d90 0x7fa08019c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42424/0 (socket says 172.21.15.7:42424) 2024-09-13T18:16:10.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 -- 172.21.15.7:0/2769889306 learned_addr learned my addr 172.21.15.7:0/2769889306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07e000640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa080073170 0x7fa0801a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 -- 172.21.15.7:0/2769889306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa080073170 msgr2=0x7fa0801a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa080073170 0x7fa0801a2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 -- 172.21.15.7:0/2769889306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa080072850 msgr2=0x7fa0801a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa080072850 0x7fa0801a26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.780+0000 7fa07f400640 1 -- 172.21.15.7:0/2769889306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070009560 con 0x7fa080110d90 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.781+0000 7fa07f400640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080110d90 0x7fa08019c800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa07800dac0 tx=0x7fa07800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.781+0000 7fa077400640 1 -- 172.21.15.7:0/2769889306 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800be30 con 0x7fa080110d90 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.781+0000 7fa077400640 1 -- 172.21.15.7:0/2769889306 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa078009900 con 0x7fa080110d90 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.781+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08019d510 con 0x7fa080110d90 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.781+0000 7fa077400640 1 -- 172.21.15.7:0/2769889306 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800f960 con 0x7fa080110d90 2024-09-13T18:16:10.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.781+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0801a96b0 con 0x7fa080110d90 2024-09-13T18:16:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.782+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa080073f90 con 0x7fa080110d90 2024-09-13T18:16:10.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.784+0000 7fa077400640 1 -- 172.21.15.7:0/2769889306 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fa078010bb0 con 0x7fa080110d90 2024-09-13T18:16:10.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.785+0000 7fa077400640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa0640a1110 0x7fa0640a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:10.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.785+0000 7fa077400640 1 -- 172.21.15.7:0/2769889306 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa0780cc8e0 con 0x7fa080110d90 2024-09-13T18:16:10.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.785+0000 7fa07ea00640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa0640a1110 0x7fa0640a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:10.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.786+0000 7fa07ea00640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa0640a1110 0x7fa0640a35d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa070005ab0 tx=0x7fa070005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:10.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.789+0000 7fa077400640 1 -- 172.21.15.7:0/2769889306 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa078095f70 con 0x7fa080110d90 2024-09-13T18:16:10.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.973+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa08019dd80 con 0x7fa080110d90 2024-09-13T18:16:10.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.973+0000 7fa077400640 1 -- 172.21.15.7:0/2769889306 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa078017090 con 0x7fa080110d90 2024-09-13T18:16:10.977 INFO:teuthology.orchestra.run.smithi007.stdout:34359738446 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa0640a1110 msgr2=0x7fa0640a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa0640a1110 0x7fa0640a35d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa070005ab0 tx=0x7fa070005a20 comp rx=0 tx=0).stop 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080110d90 msgr2=0x7fa08019c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080110d90 0x7fa08019c800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa07800dac0 tx=0x7fa07800df80 comp rx=0 tx=0).stop 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 shutdown_connections 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa0640a1110 0x7fa0640a35d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa080110d90 0x7fa08019c800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa080073170 0x7fa0801a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 --2- 172.21.15.7:0/2769889306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa080072850 0x7fa0801a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.975+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 >> 172.21.15.7:0/2769889306 conn(0x7fa0800fbae0 msgr2=0x7fa0800fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:10.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.976+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 shutdown_connections 2024-09-13T18:16:10.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:10.976+0000 7fa085800640 1 -- 172.21.15.7:0/2769889306 wait complete. 2024-09-13T18:16:11.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:11 smithi007 ceph-mon[30588]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T18:16:11.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:11 smithi007 ceph-mon[30588]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-13T18:16:11.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:11 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2769889306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:16:11.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:11 smithi116 ceph-mon[35109]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T18:16:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:11 smithi116 ceph-mon[35109]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-13T18:16:11.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:11 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2769889306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:16:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:11 smithi067 ceph-mon[35103]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T18:16:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:11 smithi067 ceph-mon[35103]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-09-13T18:16:11.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:11 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2769889306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:16:11.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 -- 172.21.15.7:0/1069994169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 msgr2=0x7f0ad810c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 --2- 172.21.15.7:0/1069994169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 0x7f0ad810c810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009ca0 tx=0x7f0ad002a950 comp rx=0 tx=0).stop 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 -- 172.21.15.7:0/1069994169 shutdown_connections 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 --2- 172.21.15.7:0/1069994169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 0x7f0ad810c810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 --2- 172.21.15.7:0/1069994169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad8101860 0x7f0ad8109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 --2- 172.21.15.7:0/1069994169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 0x7f0ad8101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 -- 172.21.15.7:0/1069994169 >> 172.21.15.7:0/1069994169 conn(0x7f0ad80fa980 msgr2=0x7f0ad80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 -- 172.21.15.7:0/1069994169 shutdown_connections 2024-09-13T18:16:11.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.667+0000 7f0adca00640 1 -- 172.21.15.7:0/1069994169 wait complete. 2024-09-13T18:16:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 Processor -- start 2024-09-13T18:16:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 -- start start 2024-09-13T18:16:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 0x7f0ad8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad8101860 0x7f0ad8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:11.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 0x7f0ad819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad819d340 con 0x7f0ad8100f40 2024-09-13T18:16:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad819d4b0 con 0x7f0ad810a370 2024-09-13T18:16:11.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.669+0000 7f0adca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad819d620 con 0x7f0ad8101860 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 0x7f0ad8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 0x7f0ad8198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42466/0 (socket says 172.21.15.7:42466) 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 -- 172.21.15.7:0/1127030735 learned_addr learned my addr 172.21.15.7:0/1127030735 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0acd400640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad8101860 0x7f0ad8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad6800640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 0x7f0ad819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 -- 172.21.15.7:0/1127030735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad8101860 msgr2=0x7f0ad8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad8101860 0x7f0ad8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 -- 172.21.15.7:0/1127030735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 msgr2=0x7f0ad819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:11.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 0x7f0ad819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.670+0000 7f0ad5e00640 1 -- 172.21.15.7:0/1127030735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009900 con 0x7f0ad8100f40 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.671+0000 7f0ad5e00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 0x7f0ad8198400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800e9f0 tx=0x7f0ac800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.671+0000 7f0acf400640 1 -- 172.21.15.7:0/1127030735 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8009700 con 0x7f0ad8100f40 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.671+0000 7f0acf400640 1 -- 172.21.15.7:0/1127030735 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ac800cd80 con 0x7f0ad8100f40 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.671+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad819d900 con 0x7f0ad8100f40 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.671+0000 7f0acf400640 1 -- 172.21.15.7:0/1127030735 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8018860 con 0x7f0ad8100f40 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.671+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad81a51c0 con 0x7f0ad8100f40 2024-09-13T18:16:11.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.672+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8069000 con 0x7f0ad8100f40 2024-09-13T18:16:11.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.674+0000 7f0acf400640 1 -- 172.21.15.7:0/1127030735 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f0ac80189c0 con 0x7f0ad8100f40 2024-09-13T18:16:11.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.675+0000 7f0acf400640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0abc0a1190 0x7f0abc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:11.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.676+0000 7f0acf400640 1 -- 172.21.15.7:0/1127030735 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0ac8014070 con 0x7f0ad8100f40 2024-09-13T18:16:11.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.676+0000 7f0acd400640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0abc0a1190 0x7f0abc0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:11.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.676+0000 7f0acd400640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0abc0a1190 0x7f0abc0a3650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ad81999b0 tx=0x7f0ac0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:11.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.679+0000 7f0acf400640 1 -- 172.21.15.7:0/1127030735 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0ac8052e20 con 0x7f0ad8100f40 2024-09-13T18:16:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.869+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ad8101320 con 0x7f0ad8100f40 2024-09-13T18:16:11.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.869+0000 7f0acf400640 1 -- 172.21.15.7:0/1127030735 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ac8096420 con 0x7f0ad8100f40 2024-09-13T18:16:11.873 INFO:teuthology.orchestra.run.smithi007.stdout:77309411397 2024-09-13T18:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0abc0a1190 msgr2=0x7f0abc0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0abc0a1190 0x7f0abc0a3650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ad81999b0 tx=0x7f0ac0005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 msgr2=0x7f0ad8198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 0x7f0ad8198400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800e9f0 tx=0x7f0ac800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 shutdown_connections 2024-09-13T18:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f0abc0a1190 0x7f0abc0a3650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ad810a370 0x7f0ad819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad8101860 0x7f0ad8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 --2- 172.21.15.7:0/1127030735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ad8100f40 0x7f0ad8198400 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.871+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 >> 172.21.15.7:0/1127030735 conn(0x7f0ad80fa980 msgr2=0x7f0ad80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.872+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 shutdown_connections 2024-09-13T18:16:11.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.872+0000 7f0adca00640 1 -- 172.21.15.7:0/1127030735 wait complete. 2024-09-13T18:16:12.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 -- 172.21.15.7:0/3869224824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102bb0 msgr2=0x7fe53c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:12.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 --2- 172.21.15.7:0/3869224824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102bb0 0x7fe53c106c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe528009930 tx=0x7fe52802a420 comp rx=0 tx=0).stop 2024-09-13T18:16:12.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 -- 172.21.15.7:0/3869224824 shutdown_connections 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 --2- 172.21.15.7:0/3869224824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c107330 0x7fe53c10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 --2- 172.21.15.7:0/3869224824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102bb0 0x7fe53c106c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 --2- 172.21.15.7:0/3869224824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe53c102200 0x7fe53c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 -- 172.21.15.7:0/3869224824 >> 172.21.15.7:0/3869224824 conn(0x7fe53c0fdc60 msgr2=0x7fe53c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 -- 172.21.15.7:0/3869224824 shutdown_connections 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.017+0000 7fe543400640 1 -- 172.21.15.7:0/3869224824 wait complete. 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.018+0000 7fe543400640 1 Processor -- start 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.018+0000 7fe543400640 1 -- start start 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.018+0000 7fe543400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102200 0x7fe53c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.018+0000 7fe543400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c102bb0 0x7fe53c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.018+0000 7fe543400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe53c107330 0x7fe53c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:12.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe543400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c19d430 con 0x7fe53c102bb0 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe543400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c19d5a0 con 0x7fe53c102200 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe543400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c19d710 con 0x7fe53c107330 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe53be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c102bb0 0x7fe53c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe53be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c102bb0 0x7fe53c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42490/0 (socket says 172.21.15.7:42490) 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe53be00640 1 -- 172.21.15.7:0/1013359283 learned_addr learned my addr 172.21.15.7:0/1013359283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe540a00640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102200 0x7fe53c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe541400640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe53c107330 0x7fe53c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe540a00640 1 -- 172.21.15.7:0/1013359283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe53c107330 msgr2=0x7fe53c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe540a00640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe53c107330 0x7fe53c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe540a00640 1 -- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c102bb0 msgr2=0x7fe53c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe540a00640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c102bb0 0x7fe53c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe540a00640 1 -- 172.21.15.7:0/1013359283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534009490 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.019+0000 7fe53be00640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c102bb0 0x7fe53c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.020+0000 7fe540a00640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102200 0x7fe53c1984f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe53000eb00 tx=0x7fe53000ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.020+0000 7fe539600640 1 -- 172.21.15.7:0/1013359283 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000ce40 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.020+0000 7fe539600640 1 -- 172.21.15.7:0/1013359283 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5300108f0 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.020+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe528009560 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.020+0000 7fe539600640 1 -- 172.21.15.7:0/1013359283 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300179f0 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.020+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53c1a50e0 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.021+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53c1036e0 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.023+0000 7fe539600640 1 -- 172.21.15.7:0/1013359283 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fe530010cb0 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.024+0000 7fe539600640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe5240a1190 0x7fe5240a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.024+0000 7fe539600640 1 -- 172.21.15.7:0/1013359283 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe530014070 con 0x7fe53c102200 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.024+0000 7fe53be00640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe5240a1190 0x7fe5240a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.025+0000 7fe53be00640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe5240a1190 0x7fe5240a3650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe528005ec0 tx=0x7fe5280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:12.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.027+0000 7fe539600640 1 -- 172.21.15.7:0/1013359283 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe530096ae0 con 0x7fe53c102200 2024-09-13T18:16:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:12 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3867639746' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T18:16:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:12 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1127030735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:16:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.208+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe53c1025e0 con 0x7fe53c102200 2024-09-13T18:16:12.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.208+0000 7fe539600640 1 -- 172.21.15.7:0/1013359283 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe53009a100 con 0x7fe53c102200 2024-09-13T18:16:12.212 INFO:teuthology.orchestra.run.smithi007.stdout:111669149759 2024-09-13T18:16:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe5240a1190 msgr2=0x7fe5240a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe5240a1190 0x7fe5240a3650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe528005ec0 tx=0x7fe5280058d0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102200 msgr2=0x7fe53c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102200 0x7fe53c1984f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe53000eb00 tx=0x7fe53000ef00 comp rx=0 tx=0).stop 2024-09-13T18:16:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 shutdown_connections 2024-09-13T18:16:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe5240a1190 0x7fe5240a3650 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe53c107330 0x7fe53c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c102bb0 0x7fe53c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 --2- 172.21.15.7:0/1013359283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe53c102200 0x7fe53c1984f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 >> 172.21.15.7:0/1013359283 conn(0x7fe53c0fdc60 msgr2=0x7fe53c0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 shutdown_connections 2024-09-13T18:16:12.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:12.211+0000 7fe543400640 1 -- 172.21.15.7:0/1013359283 wait complete. 2024-09-13T18:16:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:12 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3867639746' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T18:16:12.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:12 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1127030735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:16:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:12 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3867639746' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T18:16:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:12 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1127030735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:16:12.581 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776156 got 292057776162 for osd.9 2024-09-13T18:16:12.581 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:13.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:13 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1013359283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:16:13.192 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:13 smithi007 ceph-mon[30588]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:13.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:13 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1013359283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:16:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:13 smithi116 ceph-mon[35109]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:13 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1013359283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:16:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:13 smithi067 ceph-mon[35103]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 -- 172.21.15.7:0/3098079572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c1029c0 msgr2=0x7fc57c106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 --2- 172.21.15.7:0/3098079572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c1029c0 0x7fc57c106a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc568009930 tx=0x7fc56802a420 comp rx=0 tx=0).stop 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 -- 172.21.15.7:0/3098079572 shutdown_connections 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 --2- 172.21.15.7:0/3098079572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc57c107140 0x7fc57c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 --2- 172.21.15.7:0/3098079572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c1029c0 0x7fc57c106a10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 --2- 172.21.15.7:0/3098079572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc57c102010 0x7fc57c1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 -- 172.21.15.7:0/3098079572 >> 172.21.15.7:0/3098079572 conn(0x7fc57c0fda70 msgr2=0x7fc57c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 -- 172.21.15.7:0/3098079572 shutdown_connections 2024-09-13T18:16:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.561+0000 7fc582800640 1 -- 172.21.15.7:0/3098079572 wait complete. 2024-09-13T18:16:13.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.562+0000 7fc582800640 1 Processor -- start 2024-09-13T18:16:13.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.562+0000 7fc582800640 1 -- start start 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc582800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c102010 0x7fc57c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc582800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc57c1029c0 0x7fc57c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc582800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc57c107140 0x7fc57c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc582800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c19d1e0 con 0x7fc57c102010 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc582800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c19d350 con 0x7fc57c1029c0 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc582800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c19d4c0 con 0x7fc57c107140 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc581400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c102010 0x7fc57c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc581400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c102010 0x7fc57c1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42498/0 (socket says 172.21.15.7:42498) 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc581400640 1 -- 172.21.15.7:0/4075222571 learned_addr learned my addr 172.21.15.7:0/4075222571 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc580a00640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc57c1029c0 0x7fc57c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.563+0000 7fc581e00640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc57c107140 0x7fc57c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc581400640 1 -- 172.21.15.7:0/4075222571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc57c107140 msgr2=0x7fc57c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc581400640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc57c107140 0x7fc57c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc581400640 1 -- 172.21.15.7:0/4075222571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc57c1029c0 msgr2=0x7fc57c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc581400640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc57c1029c0 0x7fc57c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc581400640 1 -- 172.21.15.7:0/4075222571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009560 con 0x7fc57c102010 2024-09-13T18:16:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc581400640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c102010 0x7fc57c1982a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc57000e9f0 tx=0x7fc57000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc57a000640 1 -- 172.21.15.7:0/4075222571 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570009700 con 0x7fc57c102010 2024-09-13T18:16:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc57a000640 1 -- 172.21.15.7:0/4075222571 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc57000cd80 con 0x7fc57c102010 2024-09-13T18:16:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc57a000640 1 -- 172.21.15.7:0/4075222571 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570018860 con 0x7fc57c102010 2024-09-13T18:16:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.564+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c19d7a0 con 0x7fc57c102010 2024-09-13T18:16:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.565+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c1a5060 con 0x7fc57c102010 2024-09-13T18:16:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.566+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c1034f0 con 0x7fc57c102010 2024-09-13T18:16:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.568+0000 7fc57a000640 1 -- 172.21.15.7:0/4075222571 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fc5700189c0 con 0x7fc57c102010 2024-09-13T18:16:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.569+0000 7fc57a000640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc5640a1180 0x7fc5640a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.569+0000 7fc57a000640 1 -- 172.21.15.7:0/4075222571 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc570014070 con 0x7fc57c102010 2024-09-13T18:16:13.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.570+0000 7fc580a00640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc5640a1180 0x7fc5640a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:13.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.570+0000 7fc580a00640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc5640a1180 0x7fc5640a3640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc568005940 tx=0x7fc5680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.573+0000 7fc57a000640 1 -- 172.21.15.7:0/4075222571 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc570052e20 con 0x7fc57c102010 2024-09-13T18:16:13.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.757+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc57c10a380 con 0x7fc57c102010 2024-09-13T18:16:13.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.757+0000 7fc57a000640 1 -- 172.21.15.7:0/4075222571 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc570096410 con 0x7fc57c102010 2024-09-13T18:16:13.760 INFO:teuthology.orchestra.run.smithi007.stdout:201863462962 2024-09-13T18:16:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc5640a1180 msgr2=0x7fc5640a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc5640a1180 0x7fc5640a3640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc568005940 tx=0x7fc5680058d0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c102010 msgr2=0x7fc57c1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c102010 0x7fc57c1982a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc57000e9f0 tx=0x7fc57000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 shutdown_connections 2024-09-13T18:16:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc5640a1180 0x7fc5640a3640 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc57c107140 0x7fc57c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc57c1029c0 0x7fc57c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 --2- 172.21.15.7:0/4075222571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc57c102010 0x7fc57c1982a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:13.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 >> 172.21.15.7:0/4075222571 conn(0x7fc57c0fda70 msgr2=0x7fc57c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:13.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 shutdown_connections 2024-09-13T18:16:13.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:13.760+0000 7fc582800640 1 -- 172.21.15.7:0/4075222571 wait complete. 2024-09-13T18:16:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:14 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/4075222571' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T18:16:14.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:14 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/4075222571' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T18:16:14.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:14 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/4075222571' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T18:16:14.697 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462956 got 201863462962 for osd.6 2024-09-13T18:16:14.697 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:15.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:15 smithi007 ceph-mon[30588]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:15.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 -- 172.21.15.7:0/3950008237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b41029e0 msgr2=0x7f18b4106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3950008237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b41029e0 0x7f18b4106a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009930 tx=0x7f18a002a420 comp rx=0 tx=0).stop 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 -- 172.21.15.7:0/3950008237 shutdown_connections 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3950008237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18b4107160 0x7f18b410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3950008237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b41029e0 0x7f18b4106a30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3950008237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18b4102030 0x7f18b4102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 -- 172.21.15.7:0/3950008237 >> 172.21.15.7:0/3950008237 conn(0x7f18b40fda90 msgr2=0x7f18b40ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 -- 172.21.15.7:0/3950008237 shutdown_connections 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.505+0000 7f18b3e00640 1 -- 172.21.15.7:0/3950008237 wait complete. 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.506+0000 7f18b3e00640 1 Processor -- start 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.506+0000 7f18b3e00640 1 -- start start 2024-09-13T18:16:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.506+0000 7f18b3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18b4102030 0x7f18b4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.506+0000 7f18b3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18b41029e0 0x7f18b4198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b4107160 0x7f18b419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b419d290 con 0x7f18b4107160 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b419d400 con 0x7f18b4102030 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b419d570 con 0x7f18b41029e0 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b4107160 0x7f18b419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b4107160 0x7f18b419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42452/0 (socket says 172.21.15.7:42452) 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 -- 172.21.15.7:0/3867639746 learned_addr learned my addr 172.21.15.7:0/3867639746 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b2000640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18b41029e0 0x7f18b4198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b2a00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18b4102030 0x7f18b4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 -- 172.21.15.7:0/3867639746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18b41029e0 msgr2=0x7f18b4198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18b41029e0 0x7f18b4198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 -- 172.21.15.7:0/3867639746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18b4102030 msgr2=0x7f18b4198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18b4102030 0x7f18b4198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 -- 172.21.15.7:0/3867639746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac009840 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.507+0000 7f18b3400640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b4107160 0x7f18b419cc90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00efd0 tx=0x7f18ac00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.508+0000 7f18ab400640 1 -- 172.21.15.7:0/3867639746 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac009b40 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.508+0000 7f18ab400640 1 -- 172.21.15.7:0/3867639746 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18ac003b70 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.508+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a0009560 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.508+0000 7f18ab400640 1 -- 172.21.15.7:0/3867639746 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac010850 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.508+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b41a4f40 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.509+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b4103510 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.511+0000 7f18ab400640 1 -- 172.21.15.7:0/3867639746 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f18ac004b40 con 0x7f18b4107160 2024-09-13T18:16:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.512+0000 7f18ab400640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18980a1100 0x7f18980a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.513+0000 7f18ab400640 1 -- 172.21.15.7:0/3867639746 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f18ac014070 con 0x7f18b4107160 2024-09-13T18:16:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.513+0000 7f18b2a00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18980a1100 0x7f18980a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.513+0000 7f18b2a00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18980a1100 0x7f18980a35c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009bd0 tx=0x7f18a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.514+0000 7f18ab400640 1 -- 172.21.15.7:0/3867639746 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f18ac0969c0 con 0x7f18b4107160 2024-09-13T18:16:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.705+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f18b4102410 con 0x7f18b4107160 2024-09-13T18:16:15.432 INFO:teuthology.orchestra.run.smithi007.stdout:257698037801 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.706+0000 7f18ab400640 1 -- 172.21.15.7:0/3867639746 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18ac099fe0 con 0x7f18b4107160 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18980a1100 msgr2=0x7f18980a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18980a1100 0x7f18980a35c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009bd0 tx=0x7f18a4005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b4107160 msgr2=0x7f18b419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b4107160 0x7f18b419cc90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00efd0 tx=0x7f18ac00c6a0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 shutdown_connections 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18980a1100 0x7f18980a35c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b4107160 0x7f18b419cc90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18b41029e0 0x7f18b4198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 --2- 172.21.15.7:0/3867639746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18b4102030 0x7f18b4198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 >> 172.21.15.7:0/3867639746 conn(0x7f18b40fda90 msgr2=0x7f18b40fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:15.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 shutdown_connections 2024-09-13T18:16:15.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:11.708+0000 7f18b3e00640 1 -- 172.21.15.7:0/3867639746 wait complete. 2024-09-13T18:16:15.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:15 smithi116 ceph-mon[35109]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:15.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:15 smithi067 ceph-mon[35103]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:16.100 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149754 got 111669149759 for osd.3 2024-09-13T18:16:16.100 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:16.515 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411391 got 77309411397 for osd.2 2024-09-13T18:16:16.515 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:16 smithi007 ceph-mon[30588]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:16.834 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037796 got 257698037801 for osd.8 2024-09-13T18:16:16.834 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:16 smithi116 ceph-mon[35109]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:16 smithi067 ceph-mon[35103]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 -- 172.21.15.7:0/820162286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120107330 msgr2=0x7f512010eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 --2- 172.21.15.7:0/820162286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120107330 0x7f512010eeb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5118009cd0 tx=0x7f511802a8e0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 -- 172.21.15.7:0/820162286 shutdown_connections 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 --2- 172.21.15.7:0/820162286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120107330 0x7f512010eeb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 --2- 172.21.15.7:0/820162286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5120102bb0 0x7f5120106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 --2- 172.21.15.7:0/820162286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5120102200 0x7f51201025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 -- 172.21.15.7:0/820162286 >> 172.21.15.7:0/820162286 conn(0x7f51200fdc60 msgr2=0x7f5120100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.007+0000 7f5125600640 1 -- 172.21.15.7:0/820162286 shutdown_connections 2024-09-13T18:16:17.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.008+0000 7f5125600640 1 -- 172.21.15.7:0/820162286 wait complete. 2024-09-13T18:16:17.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.008+0000 7f5125600640 1 Processor -- start 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5125600640 1 -- start start 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5125600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120102200 0x7f51201984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5125600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5120102bb0 0x7f51201989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5125600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5120107330 0x7f512019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5125600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512019d3f0 con 0x7f5120102200 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5125600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512019d560 con 0x7f5120107330 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5125600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512019d6d0 con 0x7f5120102bb0 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f511ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120102200 0x7f51201984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f511ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120102200 0x7f51201984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39212/0 (socket says 172.21.15.7:39212) 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f511ea00640 1 -- 172.21.15.7:0/211374727 learned_addr learned my addr 172.21.15.7:0/211374727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f5117e00640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5120102bb0 0x7f51201989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:17.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.009+0000 7f511f400640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5120107330 0x7f512019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:17.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f511ea00640 1 -- 172.21.15.7:0/211374727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5120102bb0 msgr2=0x7f51201989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:17.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f511ea00640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5120102bb0 0x7f51201989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f511ea00640 1 -- 172.21.15.7:0/211374727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5120107330 msgr2=0x7f512019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f511ea00640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5120107330 0x7f512019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f511ea00640 1 -- 172.21.15.7:0/211374727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118009900 con 0x7f5120102200 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f5117e00640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5120102bb0 0x7f51201989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f511ea00640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120102200 0x7f51201984b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f511000e9f0 tx=0x7f511000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f5117400640 1 -- 172.21.15.7:0/211374727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110009700 con 0x7f5120102200 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f5117400640 1 -- 172.21.15.7:0/211374727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f511000cd80 con 0x7f5120102200 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512019d9b0 con 0x7f5120102200 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.010+0000 7f5117400640 1 -- 172.21.15.7:0/211374727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110018860 con 0x7f5120102200 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.011+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51201a5270 con 0x7f5120102200 2024-09-13T18:16:17.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.012+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51201036e0 con 0x7f5120102200 2024-09-13T18:16:17.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.014+0000 7f5117400640 1 -- 172.21.15.7:0/211374727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f51100189c0 con 0x7f5120102200 2024-09-13T18:16:17.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.015+0000 7f5117400640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f51040a1190 0x7f51040a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:17.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.015+0000 7f5117400640 1 -- 172.21.15.7:0/211374727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5110014070 con 0x7f5120102200 2024-09-13T18:16:17.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.015+0000 7f5117e00640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f51040a1190 0x7f51040a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:17.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.016+0000 7f5117e00640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f51040a1190 0x7f51040a3650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5120199a60 tx=0x7f5108005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:17.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.019+0000 7f5117400640 1 -- 172.21.15.7:0/211374727 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5110052e20 con 0x7f5120102200 2024-09-13T18:16:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.203+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f51201025e0 con 0x7f5120102200 2024-09-13T18:16:17.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.203+0000 7f5117400640 1 -- 172.21.15.7:0/211374727 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f5110096440 con 0x7f5120102200 2024-09-13T18:16:17.206 INFO:teuthology.orchestra.run.smithi007.stdout:313532612638 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f51040a1190 msgr2=0x7f51040a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f51040a1190 0x7f51040a3650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5120199a60 tx=0x7f5108005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120102200 msgr2=0x7f51201984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120102200 0x7f51201984b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f511000e9f0 tx=0x7f511000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 shutdown_connections 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f51040a1190 0x7f51040a3650 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5120107330 0x7f512019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5120102bb0 0x7f51201989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 --2- 172.21.15.7:0/211374727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5120102200 0x7f51201984b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 >> 172.21.15.7:0/211374727 conn(0x7f51200fdc60 msgr2=0x7f51200ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 shutdown_connections 2024-09-13T18:16:17.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:17.205+0000 7f5125600640 1 -- 172.21.15.7:0/211374727 wait complete. 2024-09-13T18:16:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:17 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/211374727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T18:16:17.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:17 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/211374727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T18:16:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:17 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/211374727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T18:16:18.016 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738442 got 34359738446 for osd.0 2024-09-13T18:16:18.016 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:18.045 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:18.046 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:18.071 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350999 got 347892351002 for osd.11 2024-09-13T18:16:18.071 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:18.715 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:18 smithi007 ceph-mon[30588]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:18.743 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612633 got 313532612638 for osd.10 2024-09-13T18:16:18.743 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:18.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:18 smithi116 ceph-mon[35109]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:18 smithi067 ceph-mon[35103]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-09-13T18:16:20.897 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:20 smithi007 ceph-mon[30588]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-13T18:16:20.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:20 smithi116 ceph-mon[35109]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-13T18:16:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:20 smithi067 ceph-mon[35103]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 -- 172.21.15.7:0/2621889025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 msgr2=0x7f819c106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 --2- 172.21.15.7:0/2621889025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 0x7f819c106a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8184009930 tx=0x7f818402a420 comp rx=0 tx=0).stop 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 -- 172.21.15.7:0/2621889025 shutdown_connections 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 --2- 172.21.15.7:0/2621889025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c107140 0x7f819c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 --2- 172.21.15.7:0/2621889025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 0x7f819c106a10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 --2- 172.21.15.7:0/2621889025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 0x7f819c1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 -- 172.21.15.7:0/2621889025 >> 172.21.15.7:0/2621889025 conn(0x7f819c0fda70 msgr2=0x7f819c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 -- 172.21.15.7:0/2621889025 shutdown_connections 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.849+0000 7f81a0e00640 1 -- 172.21.15.7:0/2621889025 wait complete. 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.850+0000 7f81a0e00640 1 Processor -- start 2024-09-13T18:16:21.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.850+0000 7f81a0e00640 1 -- start start 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.850+0000 7f81a0e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 0x7f819c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.850+0000 7f81a0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 0x7f819c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.850+0000 7f81a0e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c107140 0x7f819c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f81a0e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c19d230 con 0x7f819c1029c0 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f81a0e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c19d3a0 con 0x7f819c102010 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f81a0e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c19d510 con 0x7f819c107140 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f8192a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 0x7f819c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 0x7f819c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f8192a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 0x7f819c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39226/0 (socket says 172.21.15.7:39226) 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 0x7f819c1982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:35646/0 (socket says 172.21.15.7:35646) 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f8192a00640 1 -- 172.21.15.7:0/3017346323 learned_addr learned my addr 172.21.15.7:0/3017346323 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819be00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c107140 0x7f819c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:21.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819b400640 1 -- 172.21.15.7:0/3017346323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c107140 msgr2=0x7f819c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819b400640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c107140 0x7f819c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819b400640 1 -- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 msgr2=0x7f819c198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819b400640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 0x7f819c198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.851+0000 7f819b400640 1 -- 172.21.15.7:0/3017346323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c009490 con 0x7f819c102010 2024-09-13T18:16:21.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.852+0000 7f819b400640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 0x7f819c1982f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f818c00e9f0 tx=0x7f818c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.852+0000 7f8198c00640 1 -- 172.21.15.7:0/3017346323 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c00cd80 con 0x7f819c102010 2024-09-13T18:16:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.852+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8184009560 con 0x7f819c102010 2024-09-13T18:16:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.852+0000 7f8198c00640 1 -- 172.21.15.7:0/3017346323 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f818c0035f0 con 0x7f819c102010 2024-09-13T18:16:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.852+0000 7f8198c00640 1 -- 172.21.15.7:0/3017346323 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0044e0 con 0x7f819c102010 2024-09-13T18:16:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.852+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c1a4ee0 con 0x7f819c102010 2024-09-13T18:16:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.853+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c1034f0 con 0x7f819c102010 2024-09-13T18:16:21.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.855+0000 7f8198c00640 1 -- 172.21.15.7:0/3017346323 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f818c003a60 con 0x7f819c102010 2024-09-13T18:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.856+0000 7f8198c00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f81800a1100 0x7f81800a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.857+0000 7f8198c00640 1 -- 172.21.15.7:0/3017346323 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f818c014070 con 0x7f819c102010 2024-09-13T18:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.857+0000 7f8192a00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f81800a1100 0x7f81800a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:21.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.857+0000 7f8192a00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f81800a1100 0x7f81800a35c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8184000c00 tx=0x7f8184005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:21.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:21.859+0000 7f8198c00640 1 -- 172.21.15.7:0/3017346323 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f818c096c80 con 0x7f819c102010 2024-09-13T18:16:22.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.045+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f819c199650 con 0x7f819c102010 2024-09-13T18:16:22.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.046+0000 7f8198c00640 1 -- 172.21.15.7:0/3017346323 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f818c09a2a0 con 0x7f819c102010 2024-09-13T18:16:22.048 INFO:teuthology.orchestra.run.smithi007.stdout:146028888125 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f81800a1100 msgr2=0x7f81800a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f81800a1100 0x7f81800a35c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8184000c00 tx=0x7f8184005a20 comp rx=0 tx=0).stop 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 msgr2=0x7f819c1982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 0x7f819c1982f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f818c00e9f0 tx=0x7f818c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 shutdown_connections 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f81800a1100 0x7f81800a35c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c107140 0x7f819c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f819c1029c0 0x7f819c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 --2- 172.21.15.7:0/3017346323 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f819c102010 0x7f819c1982f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 >> 172.21.15.7:0/3017346323 conn(0x7f819c0fda70 msgr2=0x7f819c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 shutdown_connections 2024-09-13T18:16:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.048+0000 7f81a0e00640 1 -- 172.21.15.7:0/3017346323 wait complete. 2024-09-13T18:16:22.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:22 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3017346323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:16:22.472 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:22 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3017346323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:16:22.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:22 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3017346323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:16:22.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 -- 172.21.15.7:0/3209164491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c0ffe10 msgr2=0x7fbc8c1001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 --2- 172.21.15.7:0/3209164491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c0ffe10 0x7fbc8c1001f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009930 tx=0x7fbc8002a420 comp rx=0 tx=0).stop 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 -- 172.21.15.7:0/3209164491 shutdown_connections 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 --2- 172.21.15.7:0/3209164491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc8c104f40 0x7fbc8c10cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 --2- 172.21.15.7:0/3209164491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c1007c0 0x7fbc8c104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 --2- 172.21.15.7:0/3209164491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c0ffe10 0x7fbc8c1001f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 -- 172.21.15.7:0/3209164491 >> 172.21.15.7:0/3209164491 conn(0x7fbc8c0fb870 msgr2=0x7fbc8c0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 -- 172.21.15.7:0/3209164491 shutdown_connections 2024-09-13T18:16:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.854+0000 7fbc92800640 1 -- 172.21.15.7:0/3209164491 wait complete. 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 Processor -- start 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 -- start start 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc8c0ffe10 0x7fbc8c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c1007c0 0x7fbc8c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c104f40 0x7fbc8c073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a44f0 con 0x7fbc8c1007c0 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a4660 con 0x7fbc8c0ffe10 2024-09-13T18:16:22.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.855+0000 7fbc92800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a4820 con 0x7fbc8c104f40 2024-09-13T18:16:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc90a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c1007c0 0x7fbc8c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c104f40 0x7fbc8c073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc8c0ffe10 0x7fbc8c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c104f40 0x7fbc8c073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:44072/0 (socket says 172.21.15.7:44072) 2024-09-13T18:16:22.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 -- 172.21.15.7:0/1905368327 learned_addr learned my addr 172.21.15.7:0/1905368327 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 -- 172.21.15.7:0/1905368327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc8c0ffe10 msgr2=0x7fbc8c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc8c0ffe10 0x7fbc8c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 -- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c1007c0 msgr2=0x7fbc8c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c1007c0 0x7fbc8c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 -- 172.21.15.7:0/1905368327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80009560 con 0x7fbc8c104f40 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc90a00640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c1007c0 0x7fbc8c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.856+0000 7fbc91e00640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c104f40 0x7fbc8c073250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400eb10 tx=0x7fbc8400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.857+0000 7fbc8a000640 1 -- 172.21.15.7:0/1905368327 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84004b20 con 0x7fbc8c104f40 2024-09-13T18:16:22.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.857+0000 7fbc8a000640 1 -- 172.21.15.7:0/1905368327 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc84004c80 con 0x7fbc8c104f40 2024-09-13T18:16:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.857+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c1a4b00 con 0x7fbc8c104f40 2024-09-13T18:16:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.857+0000 7fbc8a000640 1 -- 172.21.15.7:0/1905368327 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84010690 con 0x7fbc8c104f40 2024-09-13T18:16:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.857+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c1a5000 con 0x7fbc8c104f40 2024-09-13T18:16:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.858+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c1012f0 con 0x7fbc8c104f40 2024-09-13T18:16:22.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.860+0000 7fbc8a000640 1 -- 172.21.15.7:0/1905368327 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fbc84005020 con 0x7fbc8c104f40 2024-09-13T18:16:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.861+0000 7fbc8a000640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc740a1180 0x7fbc740a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.861+0000 7fbc8a000640 1 -- 172.21.15.7:0/1905368327 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbc84014070 con 0x7fbc8c104f40 2024-09-13T18:16:22.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.861+0000 7fbc91400640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc740a1180 0x7fbc740a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:22.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.862+0000 7fbc91400640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc740a1180 0x7fbc740a3640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc80005940 tx=0x7fbc800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:22.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:22.864+0000 7fbc8a000640 1 -- 172.21.15.7:0/1905368327 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbc840d1070 con 0x7fbc8c104f40 2024-09-13T18:16:23.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.054+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbc8c108120 con 0x7fbc8c104f40 2024-09-13T18:16:23.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.054+0000 7fbc8a000640 1 -- 172.21.15.7:0/1905368327 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc84096550 con 0x7fbc8c104f40 2024-09-13T18:16:23.057 INFO:teuthology.orchestra.run.smithi007.stdout:167503724602 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc740a1180 msgr2=0x7fbc740a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc740a1180 0x7fbc740a3640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc80005940 tx=0x7fbc800058d0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c104f40 msgr2=0x7fbc8c073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c104f40 0x7fbc8c073250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400eb10 tx=0x7fbc8400c2d0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 shutdown_connections 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc740a1180 0x7fbc740a3640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc8c104f40 0x7fbc8c073250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc8c1007c0 0x7fbc8c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 --2- 172.21.15.7:0/1905368327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc8c0ffe10 0x7fbc8c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.056+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 >> 172.21.15.7:0/1905368327 conn(0x7fbc8c0fb870 msgr2=0x7fbc8c0fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.057+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 shutdown_connections 2024-09-13T18:16:23.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.057+0000 7fbc92800640 1 -- 172.21.15.7:0/1905368327 wait complete. 2024-09-13T18:16:23.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:23 smithi007 ceph-mon[30588]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-13T18:16:23.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:23 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1905368327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:16:23.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:23 smithi116 ceph-mon[35109]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-13T18:16:23.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:23 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1905368327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:16:23.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:23 smithi067 ceph-mon[35103]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 9 B/s, 0 keys/s, 1 objects/s recovering 2024-09-13T18:16:23.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:23 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1905368327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:16:23.752 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888120 got 146028888125 for osd.4 2024-09-13T18:16:23.752 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 -- 172.21.15.7:0/1716815828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102200 msgr2=0x7fd9cc1025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 --2- 172.21.15.7:0/1716815828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102200 0x7fd9cc1025e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009900 tx=0x7fd9c002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 -- 172.21.15.7:0/1716815828 shutdown_connections 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 --2- 172.21.15.7:0/1716815828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9cc107330 0x7fd9cc10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 --2- 172.21.15.7:0/1716815828 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9cc102bb0 0x7fd9cc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 --2- 172.21.15.7:0/1716815828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102200 0x7fd9cc1025e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 -- 172.21.15.7:0/1716815828 >> 172.21.15.7:0/1716815828 conn(0x7fd9cc0fdc60 msgr2=0x7fd9cc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 -- 172.21.15.7:0/1716815828 shutdown_connections 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.230+0000 7fd9d4600640 1 -- 172.21.15.7:0/1716815828 wait complete. 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 Processor -- start 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 -- start start 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9cc102200 0x7fd9cc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102bb0 0x7fd9cc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:23.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9cc107330 0x7fd9cc19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc19d3d0 con 0x7fd9cc107330 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc19d540 con 0x7fd9cc102200 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.231+0000 7fd9d4600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc19d6b0 con 0x7fd9cc102bb0 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102bb0 0x7fd9cc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d2600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9cc107330 0x7fd9cc19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102bb0 0x7fd9cc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:44080/0 (socket says 172.21.15.7:44080) 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 -- 172.21.15.7:0/3336790607 learned_addr learned my addr 172.21.15.7:0/3336790607 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:23.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1c00640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9cc102200 0x7fd9cc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 -- 172.21.15.7:0/3336790607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9cc102200 msgr2=0x7fd9cc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9cc102200 0x7fd9cc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 -- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9cc107330 msgr2=0x7fd9cc19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9cc107330 0x7fd9cc19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 -- 172.21.15.7:0/3336790607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4009840 con 0x7fd9cc102bb0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.232+0000 7fd9d1200640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102bb0 0x7fd9cc1989d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800e9f0 tx=0x7fd9b800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.233+0000 7fd9ca000640 1 -- 172.21.15.7:0/3336790607 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8009700 con 0x7fd9cc102bb0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.233+0000 7fd9ca000640 1 -- 172.21.15.7:0/3336790607 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9b800ccc0 con 0x7fd9cc102bb0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.233+0000 7fd9ca000640 1 -- 172.21.15.7:0/3336790607 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8018790 con 0x7fd9cc102bb0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.233+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c0009560 con 0x7fd9cc102bb0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.233+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc1a5080 con 0x7fd9cc102bb0 2024-09-13T18:16:23.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.234+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc1036e0 con 0x7fd9cc102bb0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.235+0000 7fd9ca000640 1 -- 172.21.15.7:0/3336790607 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fd9b80188f0 con 0x7fd9cc102bb0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.237+0000 7fd9ca000640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd9b40a1190 0x7fd9b40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.238+0000 7fd9ca000640 1 -- 172.21.15.7:0/3336790607 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd9b8014070 con 0x7fd9cc102bb0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.238+0000 7fd9d1c00640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd9b40a1190 0x7fd9b40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.238+0000 7fd9d1c00640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd9b40a1190 0x7fd9b40a3650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd9c002a9e0 tx=0x7fd9c0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.240+0000 7fd9ca000640 1 -- 172.21.15.7:0/3336790607 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd9b8052e20 con 0x7fd9cc102bb0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.424+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd9cc1025e0 con 0x7fd9cc102bb0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.425+0000 7fd9ca000640 1 -- 172.21.15.7:0/3336790607 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b8096450 con 0x7fd9cc102bb0 2024-09-13T18:16:23.853 INFO:teuthology.orchestra.run.smithi007.stdout:223338299438 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd9b40a1190 msgr2=0x7fd9b40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd9b40a1190 0x7fd9b40a3650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd9c002a9e0 tx=0x7fd9c0005a20 comp rx=0 tx=0).stop 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102bb0 msgr2=0x7fd9cc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102bb0 0x7fd9cc1989d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800e9f0 tx=0x7fd9b800edf0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 shutdown_connections 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd9b40a1190 0x7fd9b40a3650 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9cc107330 0x7fd9cc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc102bb0 0x7fd9cc1989d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 --2- 172.21.15.7:0/3336790607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9cc102200 0x7fd9cc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:23.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 >> 172.21.15.7:0/3336790607 conn(0x7fd9cc0fdc60 msgr2=0x7fd9cc0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 shutdown_connections 2024-09-13T18:16:23.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:23.428+0000 7fd9d4600640 1 -- 172.21.15.7:0/3336790607 wait complete. 2024-09-13T18:16:24.362 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:24 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3336790607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T18:16:24.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:24 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3336790607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T18:16:24.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:24 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3336790607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T18:16:25.307 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:25 smithi007 ceph-mon[30588]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T18:16:25.338 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299432 got 223338299438 for osd.7 2024-09-13T18:16:25.338 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:25.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:25 smithi116 ceph-mon[35109]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T18:16:25.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:25 smithi067 ceph-mon[35103]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-13T18:16:25.694 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724597 got 167503724602 for osd.5 2024-09-13T18:16:25.695 DEBUG:teuthology.parallel:result is None 2024-09-13T18:16:25.695 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T18:16:25.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T18:16:26.071 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:26.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:26 smithi007 ceph-mon[30588]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:26.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:26 smithi116 ceph-mon[35109]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:26 smithi067 ceph-mon[35103]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 -- 172.21.15.7:0/2815897289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300110d90 msgr2=0x7f3300113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 --2- 172.21.15.7:0/2815897289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300110d90 0x7f3300113180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009ca0 tx=0x7f32f802a940 comp rx=0 tx=0).stop 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 -- 172.21.15.7:0/2815897289 shutdown_connections 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 --2- 172.21.15.7:0/2815897289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300110d90 0x7f3300113180 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 --2- 172.21.15.7:0/2815897289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3300073170 0x7f3300110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 --2- 172.21.15.7:0/2815897289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3300072850 0x7f3300072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 -- 172.21.15.7:0/2815897289 >> 172.21.15.7:0/2815897289 conn(0x7f33000fba80 msgr2=0x7f33000fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 -- 172.21.15.7:0/2815897289 shutdown_connections 2024-09-13T18:16:28.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.033+0000 7f3308600640 1 -- 172.21.15.7:0/2815897289 wait complete. 2024-09-13T18:16:28.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.034+0000 7f3308600640 1 Processor -- start 2024-09-13T18:16:28.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.034+0000 7f3308600640 1 -- start start 2024-09-13T18:16:28.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3308600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3300072850 0x7f33001a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3308600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300073170 0x7f33001a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3308600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3300110d90 0x7f330019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3308600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330019ce10 con 0x7f3300073170 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3308600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330019cf80 con 0x7f3300110d90 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3308600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330019d140 con 0x7f3300072850 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3305200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300073170 0x7f33001a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3306600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3300110d90 0x7f330019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3305200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300073170 0x7f33001a2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53216/0 (socket says 172.21.15.7:53216) 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3305c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3300072850 0x7f33001a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:28.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.035+0000 7f3305200640 1 -- 172.21.15.7:0/2219914704 learned_addr learned my addr 172.21.15.7:0/2219914704 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3305c00640 1 -- 172.21.15.7:0/2219914704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3300110d90 msgr2=0x7f330019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3305c00640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3300110d90 0x7f330019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3305c00640 1 -- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300073170 msgr2=0x7f33001a2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:28.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3305c00640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300073170 0x7f33001a2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3305c00640 1 -- 172.21.15.7:0/2219914704 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec009490 con 0x7f3300072850 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3306600640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3300110d90 0x7f330019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3305200640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300073170 0x7f33001a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3305c00640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3300072850 0x7f33001a2690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32f400e9f0 tx=0x7f32f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f32fe000640 1 -- 172.21.15.7:0/2219914704 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400ccc0 con 0x7f3300072850 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f8009900 con 0x7f3300072850 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f32fe000640 1 -- 172.21.15.7:0/2219914704 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32f400ce20 con 0x7f3300072850 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f32fe000640 1 -- 172.21.15.7:0/2219914704 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4004a00 con 0x7f3300072850 2024-09-13T18:16:28.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.036+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33001a94f0 con 0x7f3300072850 2024-09-13T18:16:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.038+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3300073f90 con 0x7f3300072850 2024-09-13T18:16:28.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.040+0000 7f32fe000640 1 -- 172.21.15.7:0/2219914704 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f32f4005020 con 0x7f3300072850 2024-09-13T18:16:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.041+0000 7f32fe000640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f32e80a1110 0x7f32e80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.041+0000 7f32fe000640 1 -- 172.21.15.7:0/2219914704 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f32f4014070 con 0x7f3300072850 2024-09-13T18:16:28.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.041+0000 7f3305200640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f32e80a1110 0x7f32e80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:28.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.042+0000 7f3305200640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f32e80a1110 0x7f32e80a35d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f330019df20 tx=0x7f32ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:28.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.045+0000 7f32fe000640 1 -- 172.21.15.7:0/2219914704 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f32f4096010 con 0x7f3300072850 2024-09-13T18:16:28.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.233+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f330019dcd0 con 0x7f32e80a1110 2024-09-13T18:16:28.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.247+0000 7f32fe000640 1 -- 172.21.15.7:0/2219914704 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344916 (secure 0 0 0) 0x7f330019dcd0 con 0x7f32e80a1110 2024-09-13T18:16:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:28.256 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T18:16:28.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f32e80a1110 msgr2=0x7f32e80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:28.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f32e80a1110 0x7f32e80a35d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f330019df20 tx=0x7f32ec005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:28.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3300072850 msgr2=0x7f33001a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:28.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3300072850 0x7f33001a2690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32f400e9f0 tx=0x7f32f400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 shutdown_connections 2024-09-13T18:16:28.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f32e80a1110 0x7f32e80a35d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3300110d90 0x7f330019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.252+0000 7f3308600640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3300073170 0x7f33001a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.253+0000 7f3308600640 1 --2- 172.21.15.7:0/2219914704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3300072850 0x7f33001a2690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:28.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.253+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 >> 172.21.15.7:0/2219914704 conn(0x7f33000fba80 msgr2=0x7f33000fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:28.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.253+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 shutdown_connections 2024-09-13T18:16:28.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:28.253+0000 7f3308600640 1 -- 172.21.15.7:0/2219914704 wait complete. 2024-09-13T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:16:28.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:16:28.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:16:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:16:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:16:28.981 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-13T18:16:26.528132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658615,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":876,"num_read_kb":556,"num_write":415,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366336,"kb_used_data":13396,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124575488,"statfs":{"total":1151940427776,"available":1151565299712,"internally_reserved":0,"allocated":13717504,"data_stored":7476873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":361215301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003487"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038307+0000","last_change":"2024-09-13T18:15:06.044297+0000","last_active":"2024-09-13T18:16:09.038307+0000","last_peered":"2024-09-13T18:16:09.038307+0000","last_clean":"2024-09-13T18:16:09.038307+0000","last_became_active":"2024-09-13T18:15:06.043984+0000","last_became_peered":"2024-09-13T18:15:06.043984+0000","last_unstale":"2024-09-13T18:16:09.038307+0000","last_undegraded":"2024-09-13T18:16:09.038307+0000","last_fullsized":"2024-09-13T18:16:09.038307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:39.469599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032249+0000","last_change":"2024-09-13T18:15:06.038427+0000","last_active":"2024-09-13T18:16:09.032249+0000","last_peered":"2024-09-13T18:16:09.032249+0000","last_clean":"2024-09-13T18:16:09.032249+0000","last_became_active":"2024-09-13T18:15:06.038112+0000","last_became_peered":"2024-09-13T18:15:06.038112+0000","last_unstale":"2024-09-13T18:16:09.032249+0000","last_undegraded":"2024-09-13T18:16:09.032249+0000","last_fullsized":"2024-09-13T18:16:09.032249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:40.892099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032148+0000","last_change":"2024-09-13T18:15:06.035197+0000","last_active":"2024-09-13T18:16:09.032148+0000","last_peered":"2024-09-13T18:16:09.032148+0000","last_clean":"2024-09-13T18:16:09.032148+0000","last_became_active":"2024-09-13T18:15:06.029918+0000","last_became_peered":"2024-09-13T18:15:06.029918+0000","last_unstale":"2024-09-13T18:16:09.032148+0000","last_undegraded":"2024-09-13T18:16:09.032148+0000","last_fullsized":"2024-09-13T18:16:09.032148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:46.482020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.033963+0000","last_change":"2024-09-13T18:15:06.030482+0000","last_active":"2024-09-13T18:16:09.033963+0000","last_peered":"2024-09-13T18:16:09.033963+0000","last_clean":"2024-09-13T18:16:09.033963+0000","last_became_active":"2024-09-13T18:15:06.029980+0000","last_became_peered":"2024-09-13T18:15:06.029980+0000","last_unstale":"2024-09-13T18:16:09.033963+0000","last_undegraded":"2024-09-13T18:16:09.033963+0000","last_fullsized":"2024-09-13T18:16:09.033963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:04.488837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034521+0000","last_change":"2024-09-13T18:15:06.027624+0000","last_active":"2024-09-13T18:16:09.034521+0000","last_peered":"2024-09-13T18:16:09.034521+0000","last_clean":"2024-09-13T18:16:09.034521+0000","last_became_active":"2024-09-13T18:15:06.027353+0000","last_became_peered":"2024-09-13T18:15:06.027353+0000","last_unstale":"2024-09-13T18:16:09.034521+0000","last_undegraded":"2024-09-13T18:16:09.034521+0000","last_fullsized":"2024-09-13T18:16:09.034521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:30.159234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274595+0000","last_change":"2024-09-13T18:15:06.026446+0000","last_active":"2024-09-13T18:16:09.274595+0000","last_peered":"2024-09-13T18:16:09.274595+0000","last_clean":"2024-09-13T18:16:09.274595+0000","last_became_active":"2024-09-13T18:15:06.026115+0000","last_became_peered":"2024-09-13T18:15:06.026115+0000","last_unstale":"2024-09-13T18:16:09.274595+0000","last_undegraded":"2024-09-13T18:16:09.274595+0000","last_fullsized":"2024-09-13T18:16:09.274595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:26.449382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035920+0000","last_change":"2024-09-13T18:15:06.019147+0000","last_active":"2024-09-13T18:16:09.035920+0000","last_peered":"2024-09-13T18:16:09.035920+0000","last_clean":"2024-09-13T18:16:09.035920+0000","last_became_active":"2024-09-13T18:15:06.018239+0000","last_became_peered":"2024-09-13T18:15:06.018239+0000","last_unstale":"2024-09-13T18:16:09.035920+0000","last_undegraded":"2024-09-13T18:16:09.035920+0000","last_fullsized":"2024-09-13T18:16:09.035920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:31.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036917+0000","last_change":"2024-09-13T18:15:06.029615+0000","last_active":"2024-09-13T18:16:09.036917+0000","last_peered":"2024-09-13T18:16:09.036917+0000","last_clean":"2024-09-13T18:16:09.036917+0000","last_became_active":"2024-09-13T18:15:06.029351+0000","last_became_peered":"2024-09-13T18:15:06.029351+0000","last_unstale":"2024-09-13T18:16:09.036917+0000","last_undegraded":"2024-09-13T18:16:09.036917+0000","last_fullsized":"2024-09-13T18:16:09.036917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:36.533097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035210+0000","last_change":"2024-09-13T18:15:06.022623+0000","last_active":"2024-09-13T18:16:09.035210+0000","last_peered":"2024-09-13T18:16:09.035210+0000","last_clean":"2024-09-13T18:16:09.035210+0000","last_became_active":"2024-09-13T18:15:06.022338+0000","last_became_peered":"2024-09-13T18:15:06.022338+0000","last_unstale":"2024-09-13T18:16:09.035210+0000","last_undegraded":"2024-09-13T18:16:09.035210+0000","last_fullsized":"2024-09-13T18:16:09.035210+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:24.658524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274903+0000","last_change":"2024-09-13T18:15:06.025226+0000","last_active":"2024-09-13T18:16:09.274903+0000","last_peered":"2024-09-13T18:16:09.274903+0000","last_clean":"2024-09-13T18:16:09.274903+0000","last_became_active":"2024-09-13T18:15:06.024910+0000","last_became_peered":"2024-09-13T18:15:06.024910+0000","last_unstale":"2024-09-13T18:16:09.274903+0000","last_undegraded":"2024-09-13T18:16:09.274903+0000","last_fullsized":"2024-09-13T18:16:09.274903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:43.548175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036421+0000","last_change":"2024-09-13T18:15:06.028140+0000","last_active":"2024-09-13T18:16:09.036421+0000","last_peered":"2024-09-13T18:16:09.036421+0000","last_clean":"2024-09-13T18:16:09.036421+0000","last_became_active":"2024-09-13T18:15:06.027774+0000","last_became_peered":"2024-09-13T18:15:06.027774+0000","last_unstale":"2024-09-13T18:16:09.036421+0000","last_undegraded":"2024-09-13T18:16:09.036421+0000","last_fullsized":"2024-09-13T18:16:09.036421+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:34.454084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034299+0000","last_change":"2024-09-13T18:15:06.030264+0000","last_active":"2024-09-13T18:16:09.034299+0000","last_peered":"2024-09-13T18:16:09.034299+0000","last_clean":"2024-09-13T18:16:09.034299+0000","last_became_active":"2024-09-13T18:15:06.029571+0000","last_became_peered":"2024-09-13T18:15:06.029571+0000","last_unstale":"2024-09-13T18:16:09.034299+0000","last_undegraded":"2024-09-13T18:16:09.034299+0000","last_fullsized":"2024-09-13T18:16:09.034299+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:15.545277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035948+0000","last_change":"2024-09-13T18:15:06.029189+0000","last_active":"2024-09-13T18:16:09.035948+0000","last_peered":"2024-09-13T18:16:09.035948+0000","last_clean":"2024-09-13T18:16:09.035948+0000","last_became_active":"2024-09-13T18:15:06.028834+0000","last_became_peered":"2024-09-13T18:15:06.028834+0000","last_unstale":"2024-09-13T18:16:09.035948+0000","last_undegraded":"2024-09-13T18:16:09.035948+0000","last_fullsized":"2024-09-13T18:16:09.035948+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:21.744826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.031953+0000","last_change":"2024-09-13T18:15:06.044048+0000","last_active":"2024-09-13T18:16:09.031953+0000","last_peered":"2024-09-13T18:16:09.031953+0000","last_clean":"2024-09-13T18:16:09.031953+0000","last_became_active":"2024-09-13T18:15:06.043292+0000","last_became_peered":"2024-09-13T18:15:06.043292+0000","last_unstale":"2024-09-13T18:16:09.031953+0000","last_undegraded":"2024-09-13T18:16:09.031953+0000","last_fullsized":"2024-09-13T18:16:09.031953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:41.788308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032043+0000","last_change":"2024-09-13T18:15:06.033817+0000","last_active":"2024-09-13T18:16:09.032043+0000","last_peered":"2024-09-13T18:16:09.032043+0000","last_clean":"2024-09-13T18:16:09.032043+0000","last_became_active":"2024-09-13T18:15:06.033507+0000","last_became_peered":"2024-09-13T18:15:06.033507+0000","last_unstale":"2024-09-13T18:16:09.032043+0000","last_undegraded":"2024-09-13T18:16:09.032043+0000","last_fullsized":"2024-09-13T18:16:09.032043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:15.197681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034961+0000","last_change":"2024-09-13T18:15:06.032811+0000","last_active":"2024-09-13T18:16:09.034961+0000","last_peered":"2024-09-13T18:16:09.034961+0000","last_clean":"2024-09-13T18:16:09.034961+0000","last_became_active":"2024-09-13T18:15:06.032444+0000","last_became_peered":"2024-09-13T18:15:06.032444+0000","last_unstale":"2024-09-13T18:16:09.034961+0000","last_undegraded":"2024-09-13T18:16:09.034961+0000","last_fullsized":"2024-09-13T18:16:09.034961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:37.214417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038393+0000","last_change":"2024-09-13T18:15:06.040484+0000","last_active":"2024-09-13T18:16:09.038393+0000","last_peered":"2024-09-13T18:16:09.038393+0000","last_clean":"2024-09-13T18:16:09.038393+0000","last_became_active":"2024-09-13T18:15:06.040235+0000","last_became_peered":"2024-09-13T18:15:06.040235+0000","last_unstale":"2024-09-13T18:16:09.038393+0000","last_undegraded":"2024-09-13T18:16:09.038393+0000","last_fullsized":"2024-09-13T18:16:09.038393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:12.266079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040452+0000","last_change":"2024-09-13T18:15:06.019137+0000","last_active":"2024-09-13T18:16:09.040452+0000","last_peered":"2024-09-13T18:16:09.040452+0000","last_clean":"2024-09-13T18:16:09.040452+0000","last_became_active":"2024-09-13T18:15:06.018554+0000","last_became_peered":"2024-09-13T18:15:06.018554+0000","last_unstale":"2024-09-13T18:16:09.040452+0000","last_undegraded":"2024-09-13T18:16:09.040452+0000","last_fullsized":"2024-09-13T18:16:09.040452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:14.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036481+0000","last_change":"2024-09-13T18:15:06.026643+0000","last_active":"2024-09-13T18:16:09.036481+0000","last_peered":"2024-09-13T18:16:09.036481+0000","last_clean":"2024-09-13T18:16:09.036481+0000","last_became_active":"2024-09-13T18:15:06.026024+0000","last_became_peered":"2024-09-13T18:15:06.026024+0000","last_unstale":"2024-09-13T18:16:09.036481+0000","last_undegraded":"2024-09-13T18:16:09.036481+0000","last_fullsized":"2024-09-13T18:16:09.036481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:16.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038839+0000","last_change":"2024-09-13T18:15:06.025101+0000","last_active":"2024-09-13T18:16:09.038839+0000","last_peered":"2024-09-13T18:16:09.038839+0000","last_clean":"2024-09-13T18:16:09.038839+0000","last_became_active":"2024-09-13T18:15:06.024810+0000","last_became_peered":"2024-09-13T18:15:06.024810+0000","last_unstale":"2024-09-13T18:16:09.038839+0000","last_undegraded":"2024-09-13T18:16:09.038839+0000","last_fullsized":"2024-09-13T18:16:09.038839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.347722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036030+0000","last_change":"2024-09-13T18:15:06.044817+0000","last_active":"2024-09-13T18:16:09.036030+0000","last_peered":"2024-09-13T18:16:09.036030+0000","last_clean":"2024-09-13T18:16:09.036030+0000","last_became_active":"2024-09-13T18:15:06.044485+0000","last_became_peered":"2024-09-13T18:15:06.044485+0000","last_unstale":"2024-09-13T18:16:09.036030+0000","last_undegraded":"2024-09-13T18:16:09.036030+0000","last_fullsized":"2024-09-13T18:16:09.036030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:25.622237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035351+0000","last_change":"2024-09-13T18:15:06.030149+0000","last_active":"2024-09-13T18:16:09.035351+0000","last_peered":"2024-09-13T18:16:09.035351+0000","last_clean":"2024-09-13T18:16:09.035351+0000","last_became_active":"2024-09-13T18:15:06.029830+0000","last_became_peered":"2024-09-13T18:15:06.029830+0000","last_unstale":"2024-09-13T18:16:09.035351+0000","last_undegraded":"2024-09-13T18:16:09.035351+0000","last_fullsized":"2024-09-13T18:16:09.035351+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:37.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036712+0000","last_change":"2024-09-13T18:15:06.032485+0000","last_active":"2024-09-13T18:16:09.036712+0000","last_peered":"2024-09-13T18:16:09.036712+0000","last_clean":"2024-09-13T18:16:09.036712+0000","last_became_active":"2024-09-13T18:15:06.032041+0000","last_became_peered":"2024-09-13T18:15:06.032041+0000","last_unstale":"2024-09-13T18:16:09.036712+0000","last_undegraded":"2024-09-13T18:16:09.036712+0000","last_fullsized":"2024-09-13T18:16:09.036712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:09.793771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038760+0000","last_change":"2024-09-13T18:15:06.020133+0000","last_active":"2024-09-13T18:16:09.038760+0000","last_peered":"2024-09-13T18:16:09.038760+0000","last_clean":"2024-09-13T18:16:09.038760+0000","last_became_active":"2024-09-13T18:15:06.019829+0000","last_became_peered":"2024-09-13T18:15:06.019829+0000","last_unstale":"2024-09-13T18:16:09.038760+0000","last_undegraded":"2024-09-13T18:16:09.038760+0000","last_fullsized":"2024-09-13T18:16:09.038760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:27.635560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037811+0000","last_change":"2024-09-13T18:15:06.026796+0000","last_active":"2024-09-13T18:16:09.037811+0000","last_peered":"2024-09-13T18:16:09.037811+0000","last_clean":"2024-09-13T18:16:09.037811+0000","last_became_active":"2024-09-13T18:15:06.026449+0000","last_became_peered":"2024-09-13T18:15:06.026449+0000","last_unstale":"2024-09-13T18:16:09.037811+0000","last_undegraded":"2024-09-13T18:16:09.037811+0000","last_fullsized":"2024-09-13T18:16:09.037811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:09.825997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036519+0000","last_change":"2024-09-13T18:15:06.019787+0000","last_active":"2024-09-13T18:16:09.036519+0000","last_peered":"2024-09-13T18:16:09.036519+0000","last_clean":"2024-09-13T18:16:09.036519+0000","last_became_active":"2024-09-13T18:15:06.019514+0000","last_became_peered":"2024-09-13T18:15:06.019514+0000","last_unstale":"2024-09-13T18:16:09.036519+0000","last_undegraded":"2024-09-13T18:16:09.036519+0000","last_fullsized":"2024-09-13T18:16:09.036519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:05.614832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038403+0000","last_change":"2024-09-13T18:15:06.024397+0000","last_active":"2024-09-13T18:16:09.038403+0000","last_peered":"2024-09-13T18:16:09.038403+0000","last_clean":"2024-09-13T18:16:09.038403+0000","last_became_active":"2024-09-13T18:15:06.024089+0000","last_became_peered":"2024-09-13T18:15:06.024089+0000","last_unstale":"2024-09-13T18:16:09.038403+0000","last_undegraded":"2024-09-13T18:16:09.038403+0000","last_fullsized":"2024-09-13T18:16:09.038403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:42.590652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035761+0000","last_change":"2024-09-13T18:15:06.045070+0000","last_active":"2024-09-13T18:16:09.035761+0000","last_peered":"2024-09-13T18:16:09.035761+0000","last_clean":"2024-09-13T18:16:09.035761+0000","last_became_active":"2024-09-13T18:15:06.044098+0000","last_became_peered":"2024-09-13T18:15:06.044098+0000","last_unstale":"2024-09-13T18:16:09.035761+0000","last_undegraded":"2024-09-13T18:16:09.035761+0000","last_fullsized":"2024-09-13T18:16:09.035761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:53.943354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032289+0000","last_change":"2024-09-13T18:15:06.038938+0000","last_active":"2024-09-13T18:16:09.032289+0000","last_peered":"2024-09-13T18:16:09.032289+0000","last_clean":"2024-09-13T18:16:09.032289+0000","last_became_active":"2024-09-13T18:15:06.038432+0000","last_became_peered":"2024-09-13T18:15:06.038432+0000","last_unstale":"2024-09-13T18:16:09.032289+0000","last_undegraded":"2024-09-13T18:16:09.032289+0000","last_fullsized":"2024-09-13T18:16:09.032289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.339859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035820+0000","last_change":"2024-09-13T18:15:06.044302+0000","last_active":"2024-09-13T18:16:09.035820+0000","last_peered":"2024-09-13T18:16:09.035820+0000","last_clean":"2024-09-13T18:16:09.035820+0000","last_became_active":"2024-09-13T18:15:06.043959+0000","last_became_peered":"2024-09-13T18:15:06.043959+0000","last_unstale":"2024-09-13T18:16:09.035820+0000","last_undegraded":"2024-09-13T18:16:09.035820+0000","last_fullsized":"2024-09-13T18:16:09.035820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:06.271075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.168592+0000","last_change":"2024-09-13T18:16:10.168592+0000","last_active":"2024-09-13T18:16:10.168592+0000","last_peered":"2024-09-13T18:16:10.168592+0000","last_clean":"2024-09-13T18:16:10.168592+0000","last_became_active":"2024-09-13T18:16:10.168248+0000","last_became_peered":"2024-09-13T18:16:10.168248+0000","last_unstale":"2024-09-13T18:16:10.168592+0000","last_undegraded":"2024-09-13T18:16:10.168592+0000","last_fullsized":"2024-09-13T18:16:10.168592+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:07.267979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038232+0000","last_change":"2024-09-13T18:15:06.023969+0000","last_active":"2024-09-13T18:16:09.038232+0000","last_peered":"2024-09-13T18:16:09.038232+0000","last_clean":"2024-09-13T18:16:09.038232+0000","last_became_active":"2024-09-13T18:15:06.023641+0000","last_became_peered":"2024-09-13T18:15:06.023641+0000","last_unstale":"2024-09-13T18:16:09.038232+0000","last_undegraded":"2024-09-13T18:16:09.038232+0000","last_fullsized":"2024-09-13T18:16:09.038232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:27.188715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034464+0000","last_change":"2024-09-13T18:15:06.021576+0000","last_active":"2024-09-13T18:16:09.034464+0000","last_peered":"2024-09-13T18:16:09.034464+0000","last_clean":"2024-09-13T18:16:09.034464+0000","last_became_active":"2024-09-13T18:15:06.018911+0000","last_became_peered":"2024-09-13T18:15:06.018911+0000","last_unstale":"2024-09-13T18:16:09.034464+0000","last_undegraded":"2024-09-13T18:16:09.034464+0000","last_fullsized":"2024-09-13T18:16:09.034464+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:04.669568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:21.814760+0000","last_change":"2024-09-13T18:15:05.568259+0000","last_active":"2024-09-13T18:16:21.814760+0000","last_peered":"2024-09-13T18:16:21.814760+0000","last_clean":"2024-09-13T18:16:21.814760+0000","last_became_active":"2024-09-13T18:15:05.567888+0000","last_became_peered":"2024-09-13T18:15:05.567888+0000","last_unstale":"2024-09-13T18:16:21.814760+0000","last_undegraded":"2024-09-13T18:16:21.814760+0000","last_fullsized":"2024-09-13T18:16:21.814760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:50.942167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039111+0000","last_change":"2024-09-13T18:15:06.025868+0000","last_active":"2024-09-13T18:16:09.039111+0000","last_peered":"2024-09-13T18:16:09.039111+0000","last_clean":"2024-09-13T18:16:09.039111+0000","last_became_active":"2024-09-13T18:15:06.025583+0000","last_became_peered":"2024-09-13T18:15:06.025583+0000","last_unstale":"2024-09-13T18:16:09.039111+0000","last_undegraded":"2024-09-13T18:16:09.039111+0000","last_fullsized":"2024-09-13T18:16:09.039111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:15.774579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274650+0000","last_change":"2024-09-13T18:15:05.570260+0000","last_active":"2024-09-13T18:16:09.274650+0000","last_peered":"2024-09-13T18:16:09.274650+0000","last_clean":"2024-09-13T18:16:09.274650+0000","last_became_active":"2024-09-13T18:15:05.569942+0000","last_became_peered":"2024-09-13T18:15:05.569942+0000","last_unstale":"2024-09-13T18:16:09.274650+0000","last_undegraded":"2024-09-13T18:16:09.274650+0000","last_fullsized":"2024-09-13T18:16:09.274650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:24.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036117+0000","last_change":"2024-09-13T18:15:05.568010+0000","last_active":"2024-09-13T18:16:09.036117+0000","last_peered":"2024-09-13T18:16:09.036117+0000","last_clean":"2024-09-13T18:16:09.036117+0000","last_became_active":"2024-09-13T18:15:05.567415+0000","last_became_peered":"2024-09-13T18:15:05.567415+0000","last_unstale":"2024-09-13T18:16:09.036117+0000","last_undegraded":"2024-09-13T18:16:09.036117+0000","last_fullsized":"2024-09-13T18:16:09.036117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:26.873148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036995+0000","last_change":"2024-09-13T18:15:06.034747+0000","last_active":"2024-09-13T18:16:09.036995+0000","last_peered":"2024-09-13T18:16:09.036995+0000","last_clean":"2024-09-13T18:16:09.036995+0000","last_became_active":"2024-09-13T18:15:06.034471+0000","last_became_peered":"2024-09-13T18:15:06.034471+0000","last_unstale":"2024-09-13T18:16:09.036995+0000","last_undegraded":"2024-09-13T18:16:09.036995+0000","last_fullsized":"2024-09-13T18:16:09.036995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:25.493842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038865+0000","last_change":"2024-09-13T18:15:05.562831+0000","last_active":"2024-09-13T18:16:09.038865+0000","last_peered":"2024-09-13T18:16:09.038865+0000","last_clean":"2024-09-13T18:16:09.038865+0000","last_became_active":"2024-09-13T18:15:05.562530+0000","last_became_peered":"2024-09-13T18:15:05.562530+0000","last_unstale":"2024-09-13T18:16:09.038865+0000","last_undegraded":"2024-09-13T18:16:09.038865+0000","last_fullsized":"2024-09-13T18:16:09.038865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:00.696204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040311+0000","last_change":"2024-09-13T18:15:06.019843+0000","last_active":"2024-09-13T18:16:09.040311+0000","last_peered":"2024-09-13T18:16:09.040311+0000","last_clean":"2024-09-13T18:16:09.040311+0000","last_became_active":"2024-09-13T18:15:06.019210+0000","last_became_peered":"2024-09-13T18:15:06.019210+0000","last_unstale":"2024-09-13T18:16:09.040311+0000","last_undegraded":"2024-09-13T18:16:09.040311+0000","last_fullsized":"2024-09-13T18:16:09.040311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:05.552674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":158,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:21.814110+0000","last_change":"2024-09-13T18:15:05.567185+0000","last_active":"2024-09-13T18:16:21.814110+0000","last_peered":"2024-09-13T18:16:21.814110+0000","last_clean":"2024-09-13T18:16:21.814110+0000","last_became_active":"2024-09-13T18:15:05.566489+0000","last_became_peered":"2024-09-13T18:15:05.566489+0000","last_unstale":"2024-09-13T18:16:21.814110+0000","last_undegraded":"2024-09-13T18:16:21.814110+0000","last_fullsized":"2024-09-13T18:16:21.814110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:57.976621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035208+0000","last_change":"2024-09-13T18:15:06.021551+0000","last_active":"2024-09-13T18:16:09.035208+0000","last_peered":"2024-09-13T18:16:09.035208+0000","last_clean":"2024-09-13T18:16:09.035208+0000","last_became_active":"2024-09-13T18:15:06.021097+0000","last_became_peered":"2024-09-13T18:15:06.021097+0000","last_unstale":"2024-09-13T18:16:09.035208+0000","last_undegraded":"2024-09-13T18:16:09.035208+0000","last_fullsized":"2024-09-13T18:16:09.035208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:06.392812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036410+0000","last_change":"2024-09-13T18:15:05.567190+0000","last_active":"2024-09-13T18:16:09.036410+0000","last_peered":"2024-09-13T18:16:09.036410+0000","last_clean":"2024-09-13T18:16:09.036410+0000","last_became_active":"2024-09-13T18:15:05.566877+0000","last_became_peered":"2024-09-13T18:15:05.566877+0000","last_unstale":"2024-09-13T18:16:09.036410+0000","last_undegraded":"2024-09-13T18:16:09.036410+0000","last_fullsized":"2024-09-13T18:16:09.036410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:59.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032474+0000","last_change":"2024-09-13T18:15:06.031161+0000","last_active":"2024-09-13T18:16:09.032474+0000","last_peered":"2024-09-13T18:16:09.032474+0000","last_clean":"2024-09-13T18:16:09.032474+0000","last_became_active":"2024-09-13T18:15:06.030863+0000","last_became_peered":"2024-09-13T18:15:06.030863+0000","last_unstale":"2024-09-13T18:16:09.032474+0000","last_undegraded":"2024-09-13T18:16:09.032474+0000","last_fullsized":"2024-09-13T18:16:09.032474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:08.786051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039357+0000","last_change":"2024-09-13T18:15:05.579918+0000","last_active":"2024-09-13T18:16:09.039357+0000","last_peered":"2024-09-13T18:16:09.039357+0000","last_clean":"2024-09-13T18:16:09.039357+0000","last_became_active":"2024-09-13T18:15:05.579542+0000","last_became_peered":"2024-09-13T18:15:05.579542+0000","last_unstale":"2024-09-13T18:16:09.039357+0000","last_undegraded":"2024-09-13T18:16:09.039357+0000","last_fullsized":"2024-09-13T18:16:09.039357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:11.000542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.042689+0000","last_change":"2024-09-13T18:16:10.042689+0000","last_active":"2024-09-13T18:16:10.042689+0000","last_peered":"2024-09-13T18:16:10.042689+0000","last_clean":"2024-09-13T18:16:10.042689+0000","last_became_active":"2024-09-13T18:16:10.042270+0000","last_became_peered":"2024-09-13T18:16:10.042270+0000","last_unstale":"2024-09-13T18:16:10.042689+0000","last_undegraded":"2024-09-13T18:16:10.042689+0000","last_fullsized":"2024-09-13T18:16:10.042689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:48.747673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":192,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:21.814041+0000","last_change":"2024-09-13T18:15:05.569168+0000","last_active":"2024-09-13T18:16:21.814041+0000","last_peered":"2024-09-13T18:16:21.814041+0000","last_clean":"2024-09-13T18:16:21.814041+0000","last_became_active":"2024-09-13T18:15:05.568816+0000","last_became_peered":"2024-09-13T18:15:05.568816+0000","last_unstale":"2024-09-13T18:16:21.814041+0000","last_undegraded":"2024-09-13T18:16:21.814041+0000","last_fullsized":"2024-09-13T18:16:21.814041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:33.113730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60999,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":147,"num_read_kb":133,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034704+0000","last_change":"2024-09-13T18:15:06.022452+0000","last_active":"2024-09-13T18:16:09.034704+0000","last_peered":"2024-09-13T18:16:09.034704+0000","last_clean":"2024-09-13T18:16:09.034704+0000","last_became_active":"2024-09-13T18:15:06.022167+0000","last_became_peered":"2024-09-13T18:15:06.022167+0000","last_unstale":"2024-09-13T18:16:09.034704+0000","last_undegraded":"2024-09-13T18:16:09.034704+0000","last_fullsized":"2024-09-13T18:16:09.034704+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.389512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036514+0000","last_change":"2024-09-13T18:15:05.575305+0000","last_active":"2024-09-13T18:16:09.036514+0000","last_peered":"2024-09-13T18:16:09.036514+0000","last_clean":"2024-09-13T18:16:09.036514+0000","last_became_active":"2024-09-13T18:15:05.575023+0000","last_became_peered":"2024-09-13T18:15:05.575023+0000","last_unstale":"2024-09-13T18:16:09.036514+0000","last_undegraded":"2024-09-13T18:16:09.036514+0000","last_fullsized":"2024-09-13T18:16:09.036514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.098264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035497+0000","last_change":"2024-09-13T18:15:06.042275+0000","last_active":"2024-09-13T18:16:09.035497+0000","last_peered":"2024-09-13T18:16:09.035497+0000","last_clean":"2024-09-13T18:16:09.035497+0000","last_became_active":"2024-09-13T18:15:06.041593+0000","last_became_peered":"2024-09-13T18:15:06.041593+0000","last_unstale":"2024-09-13T18:16:09.035497+0000","last_undegraded":"2024-09-13T18:16:09.035497+0000","last_fullsized":"2024-09-13T18:16:09.035497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.550068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039122+0000","last_change":"2024-09-13T18:15:05.569419+0000","last_active":"2024-09-13T18:16:09.039122+0000","last_peered":"2024-09-13T18:16:09.039122+0000","last_clean":"2024-09-13T18:16:09.039122+0000","last_became_active":"2024-09-13T18:15:05.569126+0000","last_became_peered":"2024-09-13T18:15:05.569126+0000","last_unstale":"2024-09-13T18:16:09.039122+0000","last_undegraded":"2024-09-13T18:16:09.039122+0000","last_fullsized":"2024-09-13T18:16:09.039122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:17.133139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.041737+0000","last_change":"2024-09-13T18:16:10.041737+0000","last_active":"2024-09-13T18:16:10.041737+0000","last_peered":"2024-09-13T18:16:10.041737+0000","last_clean":"2024-09-13T18:16:10.041737+0000","last_became_active":"2024-09-13T18:16:10.041356+0000","last_became_peered":"2024-09-13T18:16:10.041356+0000","last_unstale":"2024-09-13T18:16:10.041737+0000","last_undegraded":"2024-09-13T18:16:10.041737+0000","last_fullsized":"2024-09-13T18:16:10.041737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:29.883598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:24.818460+0000","last_change":"2024-09-13T18:15:05.564102+0000","last_active":"2024-09-13T18:16:24.818460+0000","last_peered":"2024-09-13T18:16:24.818460+0000","last_clean":"2024-09-13T18:16:24.818460+0000","last_became_active":"2024-09-13T18:15:05.563784+0000","last_became_peered":"2024-09-13T18:15:05.563784+0000","last_unstale":"2024-09-13T18:16:24.818460+0000","last_undegraded":"2024-09-13T18:16:24.818460+0000","last_fullsized":"2024-09-13T18:16:24.818460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:38.285940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035741+0000","last_change":"2024-09-13T18:15:06.021229+0000","last_active":"2024-09-13T18:16:09.035741+0000","last_peered":"2024-09-13T18:16:09.035741+0000","last_clean":"2024-09-13T18:16:09.035741+0000","last_became_active":"2024-09-13T18:15:06.021010+0000","last_became_peered":"2024-09-13T18:15:06.021010+0000","last_unstale":"2024-09-13T18:16:09.035741+0000","last_undegraded":"2024-09-13T18:16:09.035741+0000","last_fullsized":"2024-09-13T18:16:09.035741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:32.149865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.180279+0000","last_change":"2024-09-13T18:16:10.180279+0000","last_active":"2024-09-13T18:16:10.180279+0000","last_peered":"2024-09-13T18:16:10.180279+0000","last_clean":"2024-09-13T18:16:10.180279+0000","last_became_active":"2024-09-13T18:16:10.169311+0000","last_became_peered":"2024-09-13T18:16:10.169311+0000","last_unstale":"2024-09-13T18:16:10.180279+0000","last_undegraded":"2024-09-13T18:16:10.180279+0000","last_fullsized":"2024-09-13T18:16:10.180279+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:42.156806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039327+0000","last_change":"2024-09-13T18:15:06.027258+0000","last_active":"2024-09-13T18:16:09.039327+0000","last_peered":"2024-09-13T18:16:09.039327+0000","last_clean":"2024-09-13T18:16:09.039327+0000","last_became_active":"2024-09-13T18:15:06.026947+0000","last_became_peered":"2024-09-13T18:15:06.026947+0000","last_unstale":"2024-09-13T18:16:09.039327+0000","last_undegraded":"2024-09-13T18:16:09.039327+0000","last_fullsized":"2024-09-13T18:16:09.039327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.227479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034859+0000","last_change":"2024-09-13T18:15:05.561141+0000","last_active":"2024-09-13T18:16:09.034859+0000","last_peered":"2024-09-13T18:16:09.034859+0000","last_clean":"2024-09-13T18:16:09.034859+0000","last_became_active":"2024-09-13T18:15:05.560824+0000","last_became_peered":"2024-09-13T18:15:05.560824+0000","last_unstale":"2024-09-13T18:16:09.034859+0000","last_undegraded":"2024-09-13T18:16:09.034859+0000","last_fullsized":"2024-09-13T18:16:09.034859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:46.213439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038234+0000","last_change":"2024-09-13T18:15:06.020893+0000","last_active":"2024-09-13T18:16:09.038234+0000","last_peered":"2024-09-13T18:16:09.038234+0000","last_clean":"2024-09-13T18:16:09.038234+0000","last_became_active":"2024-09-13T18:15:06.020586+0000","last_became_peered":"2024-09-13T18:15:06.020586+0000","last_unstale":"2024-09-13T18:16:09.038234+0000","last_undegraded":"2024-09-13T18:16:09.038234+0000","last_fullsized":"2024-09-13T18:16:09.038234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:53.793895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035771+0000","last_change":"2024-09-13T18:15:05.571263+0000","last_active":"2024-09-13T18:16:09.035771+0000","last_peered":"2024-09-13T18:16:09.035771+0000","last_clean":"2024-09-13T18:16:09.035771+0000","last_became_active":"2024-09-13T18:15:05.570520+0000","last_became_peered":"2024-09-13T18:15:05.570520+0000","last_unstale":"2024-09-13T18:16:09.035771+0000","last_undegraded":"2024-09-13T18:16:09.035771+0000","last_fullsized":"2024-09-13T18:16:09.035771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:52.401456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036628+0000","last_change":"2024-09-13T18:15:06.021756+0000","last_active":"2024-09-13T18:16:09.036628+0000","last_peered":"2024-09-13T18:16:09.036628+0000","last_clean":"2024-09-13T18:16:09.036628+0000","last_became_active":"2024-09-13T18:15:06.021398+0000","last_became_peered":"2024-09-13T18:15:06.021398+0000","last_unstale":"2024-09-13T18:16:09.036628+0000","last_undegraded":"2024-09-13T18:16:09.036628+0000","last_fullsized":"2024-09-13T18:16:09.036628+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:25.227069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039486+0000","last_change":"2024-09-13T18:15:05.570164+0000","last_active":"2024-09-13T18:16:09.039486+0000","last_peered":"2024-09-13T18:16:09.039486+0000","last_clean":"2024-09-13T18:16:09.039486+0000","last_became_active":"2024-09-13T18:15:05.569799+0000","last_became_peered":"2024-09-13T18:15:05.569799+0000","last_unstale":"2024-09-13T18:16:09.039486+0000","last_undegraded":"2024-09-13T18:16:09.039486+0000","last_fullsized":"2024-09-13T18:16:09.039486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:07.623426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035703+0000","last_change":"2024-09-13T18:15:06.024555+0000","last_active":"2024-09-13T18:16:09.035703+0000","last_peered":"2024-09-13T18:16:09.035703+0000","last_clean":"2024-09-13T18:16:09.035703+0000","last_became_active":"2024-09-13T18:15:06.023855+0000","last_became_peered":"2024-09-13T18:15:06.023855+0000","last_unstale":"2024-09-13T18:16:09.035703+0000","last_undegraded":"2024-09-13T18:16:09.035703+0000","last_fullsized":"2024-09-13T18:16:09.035703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:04.790167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:23.817270+0000","last_change":"2024-09-13T18:15:05.578930+0000","last_active":"2024-09-13T18:16:23.817270+0000","last_peered":"2024-09-13T18:16:23.817270+0000","last_clean":"2024-09-13T18:16:23.817270+0000","last_became_active":"2024-09-13T18:15:05.578597+0000","last_became_peered":"2024-09-13T18:15:05.578597+0000","last_unstale":"2024-09-13T18:16:23.817270+0000","last_undegraded":"2024-09-13T18:16:23.817270+0000","last_fullsized":"2024-09-13T18:16:23.817270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:45.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036509+0000","last_change":"2024-09-13T18:15:06.025762+0000","last_active":"2024-09-13T18:16:09.036509+0000","last_peered":"2024-09-13T18:16:09.036509+0000","last_clean":"2024-09-13T18:16:09.036509+0000","last_became_active":"2024-09-13T18:15:06.025523+0000","last_became_peered":"2024-09-13T18:15:06.025523+0000","last_unstale":"2024-09-13T18:16:09.036509+0000","last_undegraded":"2024-09-13T18:16:09.036509+0000","last_fullsized":"2024-09-13T18:16:09.036509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.430133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":328,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035851+0000","last_change":"2024-09-13T18:13:55.705797+0000","last_active":"2024-09-13T18:16:09.035851+0000","last_peered":"2024-09-13T18:16:09.035851+0000","last_clean":"2024-09-13T18:16:09.035851+0000","last_became_active":"2024-09-13T18:13:55.705398+0000","last_became_peered":"2024-09-13T18:13:55.705398+0000","last_unstale":"2024-09-13T18:16:09.035851+0000","last_undegraded":"2024-09-13T18:16:09.035851+0000","last_fullsized":"2024-09-13T18:16:09.035851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_clean_scrub_stamp":"2024-09-13T18:10:37.078709+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:10.923431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.033277+0000","last_change":"2024-09-13T18:15:05.561809+0000","last_active":"2024-09-13T18:16:09.033277+0000","last_peered":"2024-09-13T18:16:09.033277+0000","last_clean":"2024-09-13T18:16:09.033277+0000","last_became_active":"2024-09-13T18:15:05.561493+0000","last_became_peered":"2024-09-13T18:15:05.561493+0000","last_unstale":"2024-09-13T18:16:09.033277+0000","last_undegraded":"2024-09-13T18:16:09.033277+0000","last_fullsized":"2024-09-13T18:16:09.033277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.166893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.169056+0000","last_change":"2024-09-13T18:16:10.168532+0000","last_active":"2024-09-13T18:16:10.169056+0000","last_peered":"2024-09-13T18:16:10.169056+0000","last_clean":"2024-09-13T18:16:10.169056+0000","last_became_active":"2024-09-13T18:16:10.168150+0000","last_became_peered":"2024-09-13T18:16:10.168150+0000","last_unstale":"2024-09-13T18:16:10.169056+0000","last_undegraded":"2024-09-13T18:16:10.169056+0000","last_fullsized":"2024-09-13T18:16:10.169056+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:11.538267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035799+0000","last_change":"2024-09-13T18:15:05.564512+0000","last_active":"2024-09-13T18:16:09.035799+0000","last_peered":"2024-09-13T18:16:09.035799+0000","last_clean":"2024-09-13T18:16:09.035799+0000","last_became_active":"2024-09-13T18:15:05.561695+0000","last_became_peered":"2024-09-13T18:15:05.561695+0000","last_unstale":"2024-09-13T18:16:09.035799+0000","last_undegraded":"2024-09-13T18:16:09.035799+0000","last_fullsized":"2024-09-13T18:16:09.035799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:45.537500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035512+0000","last_change":"2024-09-13T18:15:06.034056+0000","last_active":"2024-09-13T18:16:09.035512+0000","last_peered":"2024-09-13T18:16:09.035512+0000","last_clean":"2024-09-13T18:16:09.035512+0000","last_became_active":"2024-09-13T18:15:06.030633+0000","last_became_peered":"2024-09-13T18:15:06.030633+0000","last_unstale":"2024-09-13T18:16:09.035512+0000","last_undegraded":"2024-09-13T18:16:09.035512+0000","last_fullsized":"2024-09-13T18:16:09.035512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:58.462828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:23.816779+0000","last_change":"2024-09-13T18:15:05.576585+0000","last_active":"2024-09-13T18:16:23.816779+0000","last_peered":"2024-09-13T18:16:23.816779+0000","last_clean":"2024-09-13T18:16:23.816779+0000","last_became_active":"2024-09-13T18:15:05.576056+0000","last_became_peered":"2024-09-13T18:15:05.576056+0000","last_unstale":"2024-09-13T18:16:23.816779+0000","last_undegraded":"2024-09-13T18:16:23.816779+0000","last_fullsized":"2024-09-13T18:16:23.816779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:25.419342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038833+0000","last_change":"2024-09-13T18:15:06.028288+0000","last_active":"2024-09-13T18:16:09.038833+0000","last_peered":"2024-09-13T18:16:09.038833+0000","last_clean":"2024-09-13T18:16:09.038833+0000","last_became_active":"2024-09-13T18:15:06.028002+0000","last_became_peered":"2024-09-13T18:15:06.028002+0000","last_unstale":"2024-09-13T18:16:09.038833+0000","last_undegraded":"2024-09-13T18:16:09.038833+0000","last_fullsized":"2024-09-13T18:16:09.038833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.258724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:21.814068+0000","last_change":"2024-09-13T18:15:05.567336+0000","last_active":"2024-09-13T18:16:21.814068+0000","last_peered":"2024-09-13T18:16:21.814068+0000","last_clean":"2024-09-13T18:16:21.814068+0000","last_became_active":"2024-09-13T18:15:05.567050+0000","last_became_peered":"2024-09-13T18:15:05.567050+0000","last_unstale":"2024-09-13T18:16:21.814068+0000","last_undegraded":"2024-09-13T18:16:21.814068+0000","last_fullsized":"2024-09-13T18:16:21.814068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:50.016671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274715+0000","last_change":"2024-09-13T18:15:06.038088+0000","last_active":"2024-09-13T18:16:09.274715+0000","last_peered":"2024-09-13T18:16:09.274715+0000","last_clean":"2024-09-13T18:16:09.274715+0000","last_became_active":"2024-09-13T18:15:06.037686+0000","last_became_peered":"2024-09-13T18:15:06.037686+0000","last_unstale":"2024-09-13T18:16:09.274715+0000","last_undegraded":"2024-09-13T18:16:09.274715+0000","last_fullsized":"2024-09-13T18:16:09.274715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:50.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040334+0000","last_change":"2024-09-13T18:15:05.572920+0000","last_active":"2024-09-13T18:16:09.040334+0000","last_peered":"2024-09-13T18:16:09.040334+0000","last_clean":"2024-09-13T18:16:09.040334+0000","last_became_active":"2024-09-13T18:15:05.572611+0000","last_became_peered":"2024-09-13T18:15:05.572611+0000","last_unstale":"2024-09-13T18:16:09.040334+0000","last_undegraded":"2024-09-13T18:16:09.040334+0000","last_fullsized":"2024-09-13T18:16:09.040334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:35.017695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274838+0000","last_change":"2024-09-13T18:15:06.035681+0000","last_active":"2024-09-13T18:16:09.274838+0000","last_peered":"2024-09-13T18:16:09.274838+0000","last_clean":"2024-09-13T18:16:09.274838+0000","last_became_active":"2024-09-13T18:15:06.035353+0000","last_became_peered":"2024-09-13T18:15:06.035353+0000","last_unstale":"2024-09-13T18:16:09.274838+0000","last_undegraded":"2024-09-13T18:16:09.274838+0000","last_fullsized":"2024-09-13T18:16:09.274838+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:09.781692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035971+0000","last_change":"2024-09-13T18:15:05.578107+0000","last_active":"2024-09-13T18:16:09.035971+0000","last_peered":"2024-09-13T18:16:09.035971+0000","last_clean":"2024-09-13T18:16:09.035971+0000","last_became_active":"2024-09-13T18:15:05.577777+0000","last_became_peered":"2024-09-13T18:15:05.577777+0000","last_unstale":"2024-09-13T18:16:09.035971+0000","last_undegraded":"2024-09-13T18:16:09.035971+0000","last_fullsized":"2024-09-13T18:16:09.035971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:37.573332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035833+0000","last_change":"2024-09-13T18:15:06.034893+0000","last_active":"2024-09-13T18:16:09.035833+0000","last_peered":"2024-09-13T18:16:09.035833+0000","last_clean":"2024-09-13T18:16:09.035833+0000","last_became_active":"2024-09-13T18:15:06.034421+0000","last_became_peered":"2024-09-13T18:15:06.034421+0000","last_unstale":"2024-09-13T18:16:09.035833+0000","last_undegraded":"2024-09-13T18:16:09.035833+0000","last_fullsized":"2024-09-13T18:16:09.035833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:23.614971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040481+0000","last_change":"2024-09-13T18:15:05.561912+0000","last_active":"2024-09-13T18:16:09.040481+0000","last_peered":"2024-09-13T18:16:09.040481+0000","last_clean":"2024-09-13T18:16:09.040481+0000","last_became_active":"2024-09-13T18:15:05.561573+0000","last_became_peered":"2024-09-13T18:15:05.561573+0000","last_unstale":"2024-09-13T18:16:09.040481+0000","last_undegraded":"2024-09-13T18:16:09.040481+0000","last_fullsized":"2024-09-13T18:16:09.040481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:06.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037867+0000","last_change":"2024-09-13T18:15:06.023273+0000","last_active":"2024-09-13T18:16:09.037867+0000","last_peered":"2024-09-13T18:16:09.037867+0000","last_clean":"2024-09-13T18:16:09.037867+0000","last_became_active":"2024-09-13T18:15:06.022980+0000","last_became_peered":"2024-09-13T18:15:06.022980+0000","last_unstale":"2024-09-13T18:16:09.037867+0000","last_undegraded":"2024-09-13T18:16:09.037867+0000","last_fullsized":"2024-09-13T18:16:09.037867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:40.966317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034490+0000","last_change":"2024-09-13T18:15:05.568210+0000","last_active":"2024-09-13T18:16:09.034490+0000","last_peered":"2024-09-13T18:16:09.034490+0000","last_clean":"2024-09-13T18:16:09.034490+0000","last_became_active":"2024-09-13T18:15:05.567881+0000","last_became_peered":"2024-09-13T18:15:05.567881+0000","last_unstale":"2024-09-13T18:16:09.034490+0000","last_undegraded":"2024-09-13T18:16:09.034490+0000","last_fullsized":"2024-09-13T18:16:09.034490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.808041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.155432+0000","last_change":"2024-09-13T18:16:10.155432+0000","last_active":"2024-09-13T18:16:10.155432+0000","last_peered":"2024-09-13T18:16:10.155432+0000","last_clean":"2024-09-13T18:16:10.155432+0000","last_became_active":"2024-09-13T18:16:10.154963+0000","last_became_peered":"2024-09-13T18:16:10.154963+0000","last_unstale":"2024-09-13T18:16:10.155432+0000","last_undegraded":"2024-09-13T18:16:10.155432+0000","last_fullsized":"2024-09-13T18:16:10.155432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:28.992501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.044560+0000","last_change":"2024-09-13T18:16:10.044560+0000","last_active":"2024-09-13T18:16:10.044560+0000","last_peered":"2024-09-13T18:16:10.044560+0000","last_clean":"2024-09-13T18:16:10.044560+0000","last_became_active":"2024-09-13T18:16:10.041701+0000","last_became_peered":"2024-09-13T18:16:10.041701+0000","last_unstale":"2024-09-13T18:16:10.044560+0000","last_undegraded":"2024-09-13T18:16:10.044560+0000","last_fullsized":"2024-09-13T18:16:10.044560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:15.058915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034283+0000","last_change":"2024-09-13T18:15:06.022444+0000","last_active":"2024-09-13T18:16:09.034283+0000","last_peered":"2024-09-13T18:16:09.034283+0000","last_clean":"2024-09-13T18:16:09.034283+0000","last_became_active":"2024-09-13T18:15:06.022134+0000","last_became_peered":"2024-09-13T18:15:06.022134+0000","last_unstale":"2024-09-13T18:16:09.034283+0000","last_undegraded":"2024-09-13T18:16:09.034283+0000","last_fullsized":"2024-09-13T18:16:09.034283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:36.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036848+0000","last_change":"2024-09-13T18:15:05.559112+0000","last_active":"2024-09-13T18:16:09.036848+0000","last_peered":"2024-09-13T18:16:09.036848+0000","last_clean":"2024-09-13T18:16:09.036848+0000","last_became_active":"2024-09-13T18:15:05.558757+0000","last_became_peered":"2024-09-13T18:15:05.558757+0000","last_unstale":"2024-09-13T18:16:09.036848+0000","last_undegraded":"2024-09-13T18:16:09.036848+0000","last_fullsized":"2024-09-13T18:16:09.036848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:57.691324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038322+0000","last_change":"2024-09-13T18:15:06.032621+0000","last_active":"2024-09-13T18:16:09.038322+0000","last_peered":"2024-09-13T18:16:09.038322+0000","last_clean":"2024-09-13T18:16:09.038322+0000","last_became_active":"2024-09-13T18:15:06.032321+0000","last_became_peered":"2024-09-13T18:15:06.032321+0000","last_unstale":"2024-09-13T18:16:09.038322+0000","last_undegraded":"2024-09-13T18:16:09.038322+0000","last_fullsized":"2024-09-13T18:16:09.038322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:59.695094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035931+0000","last_change":"2024-09-13T18:15:05.571633+0000","last_active":"2024-09-13T18:16:09.035931+0000","last_peered":"2024-09-13T18:16:09.035931+0000","last_clean":"2024-09-13T18:16:09.035931+0000","last_became_active":"2024-09-13T18:15:05.571292+0000","last_became_peered":"2024-09-13T18:15:05.571292+0000","last_unstale":"2024-09-13T18:16:09.035931+0000","last_undegraded":"2024-09-13T18:16:09.035931+0000","last_fullsized":"2024-09-13T18:16:09.035931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.452906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037398+0000","last_change":"2024-09-13T18:15:06.045725+0000","last_active":"2024-09-13T18:16:09.037398+0000","last_peered":"2024-09-13T18:16:09.037398+0000","last_clean":"2024-09-13T18:16:09.037398+0000","last_became_active":"2024-09-13T18:15:06.045401+0000","last_became_peered":"2024-09-13T18:15:06.045401+0000","last_unstale":"2024-09-13T18:16:09.037398+0000","last_undegraded":"2024-09-13T18:16:09.037398+0000","last_fullsized":"2024-09-13T18:16:09.037398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:30.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034531+0000","last_change":"2024-09-13T18:15:05.567295+0000","last_active":"2024-09-13T18:16:09.034531+0000","last_peered":"2024-09-13T18:16:09.034531+0000","last_clean":"2024-09-13T18:16:09.034531+0000","last_became_active":"2024-09-13T18:15:05.566992+0000","last_became_peered":"2024-09-13T18:15:05.566992+0000","last_unstale":"2024-09-13T18:16:09.034531+0000","last_undegraded":"2024-09-13T18:16:09.034531+0000","last_fullsized":"2024-09-13T18:16:09.034531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:27.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036188+0000","last_change":"2024-09-13T18:15:06.036750+0000","last_active":"2024-09-13T18:16:09.036188+0000","last_peered":"2024-09-13T18:16:09.036188+0000","last_clean":"2024-09-13T18:16:09.036188+0000","last_became_active":"2024-09-13T18:15:06.036424+0000","last_became_peered":"2024-09-13T18:15:06.036424+0000","last_unstale":"2024-09-13T18:16:09.036188+0000","last_undegraded":"2024-09-13T18:16:09.036188+0000","last_fullsized":"2024-09-13T18:16:09.036188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:49.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039126+0000","last_change":"2024-09-13T18:15:06.027697+0000","last_active":"2024-09-13T18:16:09.039126+0000","last_peered":"2024-09-13T18:16:09.039126+0000","last_clean":"2024-09-13T18:16:09.039126+0000","last_became_active":"2024-09-13T18:15:06.027402+0000","last_became_peered":"2024-09-13T18:15:06.027402+0000","last_unstale":"2024-09-13T18:16:09.039126+0000","last_undegraded":"2024-09-13T18:16:09.039126+0000","last_fullsized":"2024-09-13T18:16:09.039126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:45.004828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034749+0000","last_change":"2024-09-13T18:15:05.562459+0000","last_active":"2024-09-13T18:16:09.034749+0000","last_peered":"2024-09-13T18:16:09.034749+0000","last_clean":"2024-09-13T18:16:09.034749+0000","last_became_active":"2024-09-13T18:15:05.562107+0000","last_became_peered":"2024-09-13T18:15:05.562107+0000","last_unstale":"2024-09-13T18:16:09.034749+0000","last_undegraded":"2024-09-13T18:16:09.034749+0000","last_fullsized":"2024-09-13T18:16:09.034749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:39.740829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035583+0000","last_change":"2024-09-13T18:15:06.027566+0000","last_active":"2024-09-13T18:16:09.035583+0000","last_peered":"2024-09-13T18:16:09.035583+0000","last_clean":"2024-09-13T18:16:09.035583+0000","last_became_active":"2024-09-13T18:15:06.027271+0000","last_became_peered":"2024-09-13T18:15:06.027271+0000","last_unstale":"2024-09-13T18:16:09.035583+0000","last_undegraded":"2024-09-13T18:16:09.035583+0000","last_fullsized":"2024-09-13T18:16:09.035583+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:37.929848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.054601+0000","last_change":"2024-09-13T18:16:10.054180+0000","last_active":"2024-09-13T18:16:10.054601+0000","last_peered":"2024-09-13T18:16:10.054601+0000","last_clean":"2024-09-13T18:16:10.054601+0000","last_became_active":"2024-09-13T18:16:10.044444+0000","last_became_peered":"2024-09-13T18:16:10.044444+0000","last_unstale":"2024-09-13T18:16:10.054601+0000","last_undegraded":"2024-09-13T18:16:10.054601+0000","last_fullsized":"2024-09-13T18:16:10.054601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:11.967345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032420+0000","last_change":"2024-09-13T18:15:06.041388+0000","last_active":"2024-09-13T18:16:09.032420+0000","last_peered":"2024-09-13T18:16:09.032420+0000","last_clean":"2024-09-13T18:16:09.032420+0000","last_became_active":"2024-09-13T18:15:06.041102+0000","last_became_peered":"2024-09-13T18:15:06.041102+0000","last_unstale":"2024-09-13T18:16:09.032420+0000","last_undegraded":"2024-09-13T18:16:09.032420+0000","last_fullsized":"2024-09-13T18:16:09.032420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:13.919598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037427+0000","last_change":"2024-09-13T18:15:05.573970+0000","last_active":"2024-09-13T18:16:09.037427+0000","last_peered":"2024-09-13T18:16:09.037427+0000","last_clean":"2024-09-13T18:16:09.037427+0000","last_became_active":"2024-09-13T18:15:05.571778+0000","last_became_peered":"2024-09-13T18:15:05.571778+0000","last_unstale":"2024-09-13T18:16:09.037427+0000","last_undegraded":"2024-09-13T18:16:09.037427+0000","last_fullsized":"2024-09-13T18:16:09.037427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:52.799646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037508+0000","last_change":"2024-09-13T18:15:06.025563+0000","last_active":"2024-09-13T18:16:09.037508+0000","last_peered":"2024-09-13T18:16:09.037508+0000","last_clean":"2024-09-13T18:16:09.037508+0000","last_became_active":"2024-09-13T18:15:06.025257+0000","last_became_peered":"2024-09-13T18:15:06.025257+0000","last_unstale":"2024-09-13T18:16:09.037508+0000","last_undegraded":"2024-09-13T18:16:09.037508+0000","last_fullsized":"2024-09-13T18:16:09.037508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:52.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:21.813560+0000","last_change":"2024-09-13T18:15:05.562126+0000","last_active":"2024-09-13T18:16:21.813560+0000","last_peered":"2024-09-13T18:16:21.813560+0000","last_clean":"2024-09-13T18:16:21.813560+0000","last_became_active":"2024-09-13T18:15:05.561646+0000","last_became_peered":"2024-09-13T18:15:05.561646+0000","last_unstale":"2024-09-13T18:16:21.813560+0000","last_undegraded":"2024-09-13T18:16:21.813560+0000","last_fullsized":"2024-09-13T18:16:21.813560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68013,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":750,"num_read_kb":447,"num_write":232,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351006,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":958464,"data_stored":459614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78900000000000003,"5min":1.006,"15min":1.006},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70499999999999996,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70399999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.42499999999999999},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.621,"15min":0.621},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":1.115,"15min":1.115},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.79000000000000004,"5min":1.464,"15min":1.464},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.874,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.53500000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80600000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.65900000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.49099999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93100000000000005,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.47699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90700000000000003,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.629}]},{"osd":10,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.57899999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.84099999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.60099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68799999999999994}]}]},{"osd":10,"up_from":73,"seq":313532612640,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1658880,"data_stored":1112034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.38},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.36899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76900000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.63200000000000001,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75800000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.871,"15min":0.871},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53400000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82199999999999995,"5min":1.01,"15min":1.01},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.056,"15min":1.056},"last":0.66600000000000004}]},{"osd":9,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.71199999999999997}]},{"osd":11,"last update":"Fri Sep 13 18:16:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92200000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.72899999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":459592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.95199999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.34899999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.75,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.48999999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91800000000000004,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.446,"5min":0.86699999999999999,"15min":0.77100000000000002},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":18.207999999999998,"5min":18.207999999999998,"15min":18.207999999999998},"last":0.753}]},{"osd":3,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90800000000000003,"5min":0.999,"15min":0.999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96899999999999997,"5min":1.125,"15min":1.125},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.755,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88100000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.995}]},{"osd":5,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0349999999999999,"5min":2.202,"15min":2.202},"last":1.05},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0129999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.91900000000000004,"15min":0.94799999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.099,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.873,"15min":0.90000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.099}]},{"osd":7,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.85599999999999998,"15min":0.87},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0409999999999999,"5min":1.306,"15min":1.306},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98399999999999999,"5min":1.262,"15min":1.262},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.036,"15min":0.94699999999999995},"min":{"1min":0.64000000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":18.175999999999998,"5min":18.175999999999998,"15min":18.175999999999998},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.96999999999999997,"15min":0.996},"min":{"1min":0.69099999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":2.423,"15min":2.423},"last":1.194}]},{"osd":10,"last update":"Fri Sep 13 18:15:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88100000000000001,"15min":0.89100000000000001},"min":{"1min":0.67700000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0309999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.085},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.3240000000000001}]}]},{"osd":8,"up_from":60,"seq":257698037804,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":459970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.752,"5min":0.87,"15min":0.87},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38300000000000001,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48099999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41299999999999998,"15min":0.42699999999999999},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.47199999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.71199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.41699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73899999999999999,"5min":0.747,"15min":0.747},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.48399999999999999},"min":{"1min":0.32400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.52300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.62},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60999999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:15:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63600000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.64400000000000002},"min":{"1min":0.53400000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76100000000000001}]},{"osd":11,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56399999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299439,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1576960,"data_stored":1052737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73399999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.443}]},{"osd":1,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35799999999999998,"15min":0.35099999999999998},"min":{"1min":0.28499999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53500000000000003,"15min":0.52000000000000002},"min":{"1min":0.46700000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77800000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76900000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.69999999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.44,"15min":0.42999999999999999},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66300000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78900000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.627}]},{"osd":8,"last update":"Fri Sep 13 18:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.53200000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.83699999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.69499999999999995}]},{"osd":9,"last update":"Fri Sep 13 18:15:31 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.44,"5min":0.438,"15min":0.438},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.747,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.4199999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":0.68100000000000005}]},{"osd":10,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67000000000000004,"15min":0.67800000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.64900000000000002}]},{"osd":11,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.753}]}]},{"osd":6,"up_from":47,"seq":201863462965,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":966656,"data_stored":459261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.746,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.871,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93600000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0309999999999999,"5min":1.044,"15min":1.044},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.24,"5min":0.81200000000000006,"15min":0.73599999999999999},"min":{"1min":0.433,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":11.686,"5min":11.686,"15min":11.686},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95799999999999996,"5min":1.397,"15min":1.397},"last":0.438},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65400000000000003,"15min":0.63900000000000001},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93400000000000005,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.165,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97299999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.22,"15min":1.22},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.79100000000000004,"15min":0.77000000000000002},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1000000000000001,"5min":1.486,"15min":1.486},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79900000000000004,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.997,"5min":1.212,"15min":1.212},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.56899999999999995,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.53300000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:16:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.91700000000000004,"15min":0.83199999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93000000000000005,"5min":11.670999999999999,"15min":11.670999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.88300000000000001,"15min":0.873},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.71499999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:15:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.89500000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1379999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64400000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:15:58 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1220000000000001,"5min":1.286,"15min":1.286},"last":0.629},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.97499999999999998,"15min":0.996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.1659999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.69099999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724603,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32668,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712484,"statfs":{"total":95995035648,"available":95961583616,"internally_reserved":0,"allocated":1585152,"data_stored":1051838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61699999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":1.175,"15min":1.175},"last":0.379}]},{"osd":1,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52600000000000002,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77800000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.496},"min":{"1min":0.374,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.252,"5min":0.251,"15min":0.251},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.39200000000000002},"min":{"1min":0.24199999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.60699999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.435},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69399999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86099999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86799999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85399999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45500000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:15:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.47599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58699999999999997}]},{"osd":8,"last update":"Fri Sep 13 18:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.502,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.76500000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.52500000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:15:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.5}]},{"osd":10,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.68200000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":974848,"data_stored":459626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.48999999999999999},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.372},"min":{"1min":0.29299999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81699999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:15:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82399999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.58999999999999997,"15min":0.55800000000000005},"min":{"1min":0.45800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:16:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73799999999999999,"5min":0.873,"15min":0.873},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:15:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.51300000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.39400000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89700000000000002,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.875,"5min":18.643000000000001,"15min":18.643000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93500000000000005,"15min":0.72199999999999998},"min":{"1min":0.60799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.95799999999999996,"5min":18.629999999999999,"15min":18.629999999999999},"last":0.57699999999999996}]},{"osd":9,"last update":"Fri Sep 13 18:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.57699999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91400000000000003,"5min":1.123,"15min":1.123},"last":0.754},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997}]},{"osd":10,"last update":"Fri Sep 13 18:15:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.51900000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83599999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97199999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.71999999999999997}]},{"osd":11,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68600000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":978944,"data_stored":458803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.46000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.59699999999999998,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.63800000000000001,"15min":0.59799999999999998},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.64200000000000002,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.71599999999999997,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.68700000000000006,"15min":0.63700000000000001},"min":{"1min":0.51300000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:16:01 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.69299999999999995,"15min":0.66500000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.72999999999999998,"15min":0.68899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.69899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:15:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81599999999999995,"15min":0.78400000000000003},"min":{"1min":0.57599999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.745,"15min":0.72399999999999998},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.749}]},{"osd":8,"last update":"Fri Sep 13 18:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.88},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.1499999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95199999999999996,"15min":0.94299999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.79600000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:15:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79200000000000004,"15min":0.78700000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.623},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.96699999999999997,"15min":0.95899999999999996},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.80600000000000005}]},{"osd":11,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.77000000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":521625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.56499999999999995,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.41999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.748,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.74199999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.62},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.42199999999999999},"min":{"1min":0.34200000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.67100000000000004,"15min":0.60999999999999999},"min":{"1min":0.42399999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.746},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.66100000000000003,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.436,"15min":0.436},"max":{"1min":6.4509999999999996,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68200000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71799999999999997,"5min":1.135,"15min":1.135},"last":0.72199999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71599999999999997,"15min":0.70299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.0179999999999998,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70999999999999996}]},{"osd":10,"last update":"Fri Sep 13 18:15:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.52600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82699999999999996,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.65100000000000002}]},{"osd":11,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.75800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55600000000000005,"15min":0.52100000000000002},"min":{"1min":0.41399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.82699999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.58299999999999996,"15min":0.53900000000000003},"min":{"1min":0.496,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83799999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:15:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.38200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53600000000000003,"15min":0.51300000000000001},"min":{"1min":0.47199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.496}]},{"osd":3,"last update":"Fri Sep 13 18:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59099999999999997,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.64100000000000001,"15min":0.59299999999999997},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.7389999999999999,"5min":4.7389999999999999,"15min":4.7389999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.39900000000000002},"min":{"1min":0.36399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.44700000000000001},"min":{"1min":0.311,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57799999999999996,"15min":0.54700000000000004},"min":{"1min":0.51500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.59899999999999998,"15min":0.55500000000000005},"min":{"1min":0.53700000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66100000000000003,"15min":0.61699999999999999},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93999999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:15:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.54700000000000004,"15min":0.52000000000000002},"min":{"1min":0.41199999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.372},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84399999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.39200000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.57299999999999995},"min":{"1min":0.47799999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.68400000000000005,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71399999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.56999999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.59399999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.94899999999999995,"5min":1.002,"15min":1.002},"last":0.82999999999999996}]},{"osd":10,"last update":"Fri Sep 13 18:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92400000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51200000000000001}]},{"osd":11,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.76700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":460600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.53700000000000003},"min":{"1min":0.44600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.88200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:15:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.629,"15min":0.58299999999999996},"min":{"1min":0.50800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60499999999999998,"15min":0.55300000000000005},"min":{"1min":0.45400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89300000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.629,"15min":0.60099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95299999999999996,"5min":1.069,"15min":1.069},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:15:58 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.69699999999999995},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.61399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.046,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 18:14:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.755,"15min":0.751},"min":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69699999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81999999999999995,"15min":0.84299999999999997},"min":{"1min":0.57599999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.82099999999999995,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79800000000000004}]},{"osd":9,"last update":"Fri Sep 13 18:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.92300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.139,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79200000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:15:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.876,"15min":0.88},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88400000000000001,"15min":0.88700000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.95099999999999996}]},{"osd":11,"last update":"Fri Sep 13 18:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.871}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:16:28.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T18:16:29.309 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:29.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:29 smithi116 ceph-mon[35109]: from='client.24904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:16:29.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:29 smithi116 ceph-mon[35109]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:29.745 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:29 smithi007 ceph-mon[30588]: from='client.24904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:16:29.745 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:29 smithi007 ceph-mon[30588]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:29.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:29 smithi067 ceph-mon[35103]: from='client.24904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:16:29.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:29 smithi067 ceph-mon[35103]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:30.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:30 smithi007 ceph-mon[30588]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:16:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:30 smithi116 ceph-mon[35109]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:16:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:30 smithi067 ceph-mon[35103]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 -- 172.21.15.7:0/3501977805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102bb0 msgr2=0x7fa184106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 --2- 172.21.15.7:0/3501977805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102bb0 0x7fa184106c00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa170009930 tx=0x7fa17002a420 comp rx=0 tx=0).stop 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 -- 172.21.15.7:0/3501977805 shutdown_connections 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 --2- 172.21.15.7:0/3501977805 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa184107330 0x7fa18410eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 --2- 172.21.15.7:0/3501977805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102bb0 0x7fa184106c00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 --2- 172.21.15.7:0/3501977805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa184102200 0x7fa1841025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 -- 172.21.15.7:0/3501977805 >> 172.21.15.7:0/3501977805 conn(0x7fa1840fdc40 msgr2=0x7fa184100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 -- 172.21.15.7:0/3501977805 shutdown_connections 2024-09-13T18:16:31.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.197+0000 7fa18c600640 1 -- 172.21.15.7:0/3501977805 wait complete. 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.198+0000 7fa18c600640 1 Processor -- start 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.198+0000 7fa18c600640 1 -- start start 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa18c600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102200 0x7fa184198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa18c600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa184102bb0 0x7fa184198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa18c600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa184107330 0x7fa18419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa18c600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18419d480 con 0x7fa184102200 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa18c600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18419d5f0 con 0x7fa184102bb0 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa18c600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18419d760 con 0x7fa184107330 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa189c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102200 0x7fa184198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:31.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa189c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102200 0x7fa184198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53238/0 (socket says 172.21.15.7:53238) 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa189c00640 1 -- 172.21.15.7:0/1335815716 learned_addr learned my addr 172.21.15.7:0/1335815716 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa189200640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa184102bb0 0x7fa184198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.199+0000 7fa18a600640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa184107330 0x7fa18419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa189c00640 1 -- 172.21.15.7:0/1335815716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa184107330 msgr2=0x7fa18419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa189c00640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa184107330 0x7fa18419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa189c00640 1 -- 172.21.15.7:0/1335815716 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa184102bb0 msgr2=0x7fa184198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa189c00640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa184102bb0 0x7fa184198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa189c00640 1 -- 172.21.15.7:0/1335815716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170009560 con 0x7fa184102200 2024-09-13T18:16:31.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa189c00640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102200 0x7fa184198540 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa17800eb90 tx=0x7fa17800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:31.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa182000640 1 -- 172.21.15.7:0/1335815716 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780099b0 con 0x7fa184102200 2024-09-13T18:16:31.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa182000640 1 -- 172.21.15.7:0/1335815716 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa17800ee90 con 0x7fa184102200 2024-09-13T18:16:31.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa182000640 1 -- 172.21.15.7:0/1335815716 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178010670 con 0x7fa184102200 2024-09-13T18:16:31.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18419da40 con 0x7fa184102200 2024-09-13T18:16:31.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.200+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18419dcf0 con 0x7fa184102200 2024-09-13T18:16:31.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.201+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1841036e0 con 0x7fa184102200 2024-09-13T18:16:31.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.203+0000 7fa182000640 1 -- 172.21.15.7:0/1335815716 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fa178005020 con 0x7fa184102200 2024-09-13T18:16:31.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.204+0000 7fa182000640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa16c0a1190 0x7fa16c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:31.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.205+0000 7fa182000640 1 -- 172.21.15.7:0/1335815716 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa178014070 con 0x7fa184102200 2024-09-13T18:16:31.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.205+0000 7fa189200640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa16c0a1190 0x7fa16c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:31.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.206+0000 7fa189200640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa16c0a1190 0x7fa16c0a3650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa170031440 tx=0x7fa170005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:31.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.209+0000 7fa182000640 1 -- 172.21.15.7:0/1335815716 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa1780d2020 con 0x7fa184102200 2024-09-13T18:16:31.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.384+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa18419dcf0 con 0x7fa16c0a1190 2024-09-13T18:16:31.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.394+0000 7fa182000640 1 -- 172.21.15.7:0/1335815716 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344965 (secure 0 0 0) 0x7fa18419dcf0 con 0x7fa16c0a1190 2024-09-13T18:16:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:31.402 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T18:16:31.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa16c0a1190 msgr2=0x7fa16c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:31.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa16c0a1190 0x7fa16c0a3650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa170031440 tx=0x7fa170005a20 comp rx=0 tx=0).stop 2024-09-13T18:16:31.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102200 msgr2=0x7fa184198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:31.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102200 0x7fa184198540 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa17800eb90 tx=0x7fa17800c6a0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 shutdown_connections 2024-09-13T18:16:31.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa16c0a1190 0x7fa16c0a3650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa184107330 0x7fa18419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa184102bb0 0x7fa184198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 --2- 172.21.15.7:0/1335815716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa184102200 0x7fa184198540 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:31.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.398+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 >> 172.21.15.7:0/1335815716 conn(0x7fa1840fdc40 msgr2=0x7fa1840ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:31.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.399+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 shutdown_connections 2024-09-13T18:16:31.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:31.399+0000 7fa18c600640 1 -- 172.21.15.7:0/1335815716 wait complete. 2024-09-13T18:16:31.775 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:31 smithi007 ceph-mon[30588]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:16:31.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:31 smithi116 ceph-mon[35109]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:16:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:31 smithi067 ceph-mon[35103]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:16:32.130 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-13T18:16:30.529076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658615,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":911,"num_read_kb":576,"num_write":415,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366336,"kb_used_data":13396,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124575488,"statfs":{"total":1151940427776,"available":1151565299712,"internally_reserved":0,"allocated":13717504,"data_stored":7476873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":361215301},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038307+0000","last_change":"2024-09-13T18:15:06.044297+0000","last_active":"2024-09-13T18:16:09.038307+0000","last_peered":"2024-09-13T18:16:09.038307+0000","last_clean":"2024-09-13T18:16:09.038307+0000","last_became_active":"2024-09-13T18:15:06.043984+0000","last_became_peered":"2024-09-13T18:15:06.043984+0000","last_unstale":"2024-09-13T18:16:09.038307+0000","last_undegraded":"2024-09-13T18:16:09.038307+0000","last_fullsized":"2024-09-13T18:16:09.038307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:39.469599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032249+0000","last_change":"2024-09-13T18:15:06.038427+0000","last_active":"2024-09-13T18:16:09.032249+0000","last_peered":"2024-09-13T18:16:09.032249+0000","last_clean":"2024-09-13T18:16:09.032249+0000","last_became_active":"2024-09-13T18:15:06.038112+0000","last_became_peered":"2024-09-13T18:15:06.038112+0000","last_unstale":"2024-09-13T18:16:09.032249+0000","last_undegraded":"2024-09-13T18:16:09.032249+0000","last_fullsized":"2024-09-13T18:16:09.032249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:40.892099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032148+0000","last_change":"2024-09-13T18:15:06.035197+0000","last_active":"2024-09-13T18:16:09.032148+0000","last_peered":"2024-09-13T18:16:09.032148+0000","last_clean":"2024-09-13T18:16:09.032148+0000","last_became_active":"2024-09-13T18:15:06.029918+0000","last_became_peered":"2024-09-13T18:15:06.029918+0000","last_unstale":"2024-09-13T18:16:09.032148+0000","last_undegraded":"2024-09-13T18:16:09.032148+0000","last_fullsized":"2024-09-13T18:16:09.032148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:46.482020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.033963+0000","last_change":"2024-09-13T18:15:06.030482+0000","last_active":"2024-09-13T18:16:09.033963+0000","last_peered":"2024-09-13T18:16:09.033963+0000","last_clean":"2024-09-13T18:16:09.033963+0000","last_became_active":"2024-09-13T18:15:06.029980+0000","last_became_peered":"2024-09-13T18:15:06.029980+0000","last_unstale":"2024-09-13T18:16:09.033963+0000","last_undegraded":"2024-09-13T18:16:09.033963+0000","last_fullsized":"2024-09-13T18:16:09.033963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:04.488837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034521+0000","last_change":"2024-09-13T18:15:06.027624+0000","last_active":"2024-09-13T18:16:09.034521+0000","last_peered":"2024-09-13T18:16:09.034521+0000","last_clean":"2024-09-13T18:16:09.034521+0000","last_became_active":"2024-09-13T18:15:06.027353+0000","last_became_peered":"2024-09-13T18:15:06.027353+0000","last_unstale":"2024-09-13T18:16:09.034521+0000","last_undegraded":"2024-09-13T18:16:09.034521+0000","last_fullsized":"2024-09-13T18:16:09.034521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:30.159234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274595+0000","last_change":"2024-09-13T18:15:06.026446+0000","last_active":"2024-09-13T18:16:09.274595+0000","last_peered":"2024-09-13T18:16:09.274595+0000","last_clean":"2024-09-13T18:16:09.274595+0000","last_became_active":"2024-09-13T18:15:06.026115+0000","last_became_peered":"2024-09-13T18:15:06.026115+0000","last_unstale":"2024-09-13T18:16:09.274595+0000","last_undegraded":"2024-09-13T18:16:09.274595+0000","last_fullsized":"2024-09-13T18:16:09.274595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:26.449382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035920+0000","last_change":"2024-09-13T18:15:06.019147+0000","last_active":"2024-09-13T18:16:09.035920+0000","last_peered":"2024-09-13T18:16:09.035920+0000","last_clean":"2024-09-13T18:16:09.035920+0000","last_became_active":"2024-09-13T18:15:06.018239+0000","last_became_peered":"2024-09-13T18:15:06.018239+0000","last_unstale":"2024-09-13T18:16:09.035920+0000","last_undegraded":"2024-09-13T18:16:09.035920+0000","last_fullsized":"2024-09-13T18:16:09.035920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:31.325596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036917+0000","last_change":"2024-09-13T18:15:06.029615+0000","last_active":"2024-09-13T18:16:09.036917+0000","last_peered":"2024-09-13T18:16:09.036917+0000","last_clean":"2024-09-13T18:16:09.036917+0000","last_became_active":"2024-09-13T18:15:06.029351+0000","last_became_peered":"2024-09-13T18:15:06.029351+0000","last_unstale":"2024-09-13T18:16:09.036917+0000","last_undegraded":"2024-09-13T18:16:09.036917+0000","last_fullsized":"2024-09-13T18:16:09.036917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:36.533097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035210+0000","last_change":"2024-09-13T18:15:06.022623+0000","last_active":"2024-09-13T18:16:09.035210+0000","last_peered":"2024-09-13T18:16:09.035210+0000","last_clean":"2024-09-13T18:16:09.035210+0000","last_became_active":"2024-09-13T18:15:06.022338+0000","last_became_peered":"2024-09-13T18:15:06.022338+0000","last_unstale":"2024-09-13T18:16:09.035210+0000","last_undegraded":"2024-09-13T18:16:09.035210+0000","last_fullsized":"2024-09-13T18:16:09.035210+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:24.658524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274903+0000","last_change":"2024-09-13T18:15:06.025226+0000","last_active":"2024-09-13T18:16:09.274903+0000","last_peered":"2024-09-13T18:16:09.274903+0000","last_clean":"2024-09-13T18:16:09.274903+0000","last_became_active":"2024-09-13T18:15:06.024910+0000","last_became_peered":"2024-09-13T18:15:06.024910+0000","last_unstale":"2024-09-13T18:16:09.274903+0000","last_undegraded":"2024-09-13T18:16:09.274903+0000","last_fullsized":"2024-09-13T18:16:09.274903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:43.548175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036421+0000","last_change":"2024-09-13T18:15:06.028140+0000","last_active":"2024-09-13T18:16:09.036421+0000","last_peered":"2024-09-13T18:16:09.036421+0000","last_clean":"2024-09-13T18:16:09.036421+0000","last_became_active":"2024-09-13T18:15:06.027774+0000","last_became_peered":"2024-09-13T18:15:06.027774+0000","last_unstale":"2024-09-13T18:16:09.036421+0000","last_undegraded":"2024-09-13T18:16:09.036421+0000","last_fullsized":"2024-09-13T18:16:09.036421+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:34.454084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034299+0000","last_change":"2024-09-13T18:15:06.030264+0000","last_active":"2024-09-13T18:16:09.034299+0000","last_peered":"2024-09-13T18:16:09.034299+0000","last_clean":"2024-09-13T18:16:09.034299+0000","last_became_active":"2024-09-13T18:15:06.029571+0000","last_became_peered":"2024-09-13T18:15:06.029571+0000","last_unstale":"2024-09-13T18:16:09.034299+0000","last_undegraded":"2024-09-13T18:16:09.034299+0000","last_fullsized":"2024-09-13T18:16:09.034299+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:15.545277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035948+0000","last_change":"2024-09-13T18:15:06.029189+0000","last_active":"2024-09-13T18:16:09.035948+0000","last_peered":"2024-09-13T18:16:09.035948+0000","last_clean":"2024-09-13T18:16:09.035948+0000","last_became_active":"2024-09-13T18:15:06.028834+0000","last_became_peered":"2024-09-13T18:15:06.028834+0000","last_unstale":"2024-09-13T18:16:09.035948+0000","last_undegraded":"2024-09-13T18:16:09.035948+0000","last_fullsized":"2024-09-13T18:16:09.035948+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:21.744826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.031953+0000","last_change":"2024-09-13T18:15:06.044048+0000","last_active":"2024-09-13T18:16:09.031953+0000","last_peered":"2024-09-13T18:16:09.031953+0000","last_clean":"2024-09-13T18:16:09.031953+0000","last_became_active":"2024-09-13T18:15:06.043292+0000","last_became_peered":"2024-09-13T18:15:06.043292+0000","last_unstale":"2024-09-13T18:16:09.031953+0000","last_undegraded":"2024-09-13T18:16:09.031953+0000","last_fullsized":"2024-09-13T18:16:09.031953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:41.788308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032043+0000","last_change":"2024-09-13T18:15:06.033817+0000","last_active":"2024-09-13T18:16:09.032043+0000","last_peered":"2024-09-13T18:16:09.032043+0000","last_clean":"2024-09-13T18:16:09.032043+0000","last_became_active":"2024-09-13T18:15:06.033507+0000","last_became_peered":"2024-09-13T18:15:06.033507+0000","last_unstale":"2024-09-13T18:16:09.032043+0000","last_undegraded":"2024-09-13T18:16:09.032043+0000","last_fullsized":"2024-09-13T18:16:09.032043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:15.197681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034961+0000","last_change":"2024-09-13T18:15:06.032811+0000","last_active":"2024-09-13T18:16:09.034961+0000","last_peered":"2024-09-13T18:16:09.034961+0000","last_clean":"2024-09-13T18:16:09.034961+0000","last_became_active":"2024-09-13T18:15:06.032444+0000","last_became_peered":"2024-09-13T18:15:06.032444+0000","last_unstale":"2024-09-13T18:16:09.034961+0000","last_undegraded":"2024-09-13T18:16:09.034961+0000","last_fullsized":"2024-09-13T18:16:09.034961+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:37.214417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038393+0000","last_change":"2024-09-13T18:15:06.040484+0000","last_active":"2024-09-13T18:16:09.038393+0000","last_peered":"2024-09-13T18:16:09.038393+0000","last_clean":"2024-09-13T18:16:09.038393+0000","last_became_active":"2024-09-13T18:15:06.040235+0000","last_became_peered":"2024-09-13T18:15:06.040235+0000","last_unstale":"2024-09-13T18:16:09.038393+0000","last_undegraded":"2024-09-13T18:16:09.038393+0000","last_fullsized":"2024-09-13T18:16:09.038393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:12.266079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040452+0000","last_change":"2024-09-13T18:15:06.019137+0000","last_active":"2024-09-13T18:16:09.040452+0000","last_peered":"2024-09-13T18:16:09.040452+0000","last_clean":"2024-09-13T18:16:09.040452+0000","last_became_active":"2024-09-13T18:15:06.018554+0000","last_became_peered":"2024-09-13T18:15:06.018554+0000","last_unstale":"2024-09-13T18:16:09.040452+0000","last_undegraded":"2024-09-13T18:16:09.040452+0000","last_fullsized":"2024-09-13T18:16:09.040452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:15:14.853573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036481+0000","last_change":"2024-09-13T18:15:06.026643+0000","last_active":"2024-09-13T18:16:09.036481+0000","last_peered":"2024-09-13T18:16:09.036481+0000","last_clean":"2024-09-13T18:16:09.036481+0000","last_became_active":"2024-09-13T18:15:06.026024+0000","last_became_peered":"2024-09-13T18:15:06.026024+0000","last_unstale":"2024-09-13T18:16:09.036481+0000","last_undegraded":"2024-09-13T18:16:09.036481+0000","last_fullsized":"2024-09-13T18:16:09.036481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:16.495432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038839+0000","last_change":"2024-09-13T18:15:06.025101+0000","last_active":"2024-09-13T18:16:09.038839+0000","last_peered":"2024-09-13T18:16:09.038839+0000","last_clean":"2024-09-13T18:16:09.038839+0000","last_became_active":"2024-09-13T18:15:06.024810+0000","last_became_peered":"2024-09-13T18:15:06.024810+0000","last_unstale":"2024-09-13T18:16:09.038839+0000","last_undegraded":"2024-09-13T18:16:09.038839+0000","last_fullsized":"2024-09-13T18:16:09.038839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.347722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036030+0000","last_change":"2024-09-13T18:15:06.044817+0000","last_active":"2024-09-13T18:16:09.036030+0000","last_peered":"2024-09-13T18:16:09.036030+0000","last_clean":"2024-09-13T18:16:09.036030+0000","last_became_active":"2024-09-13T18:15:06.044485+0000","last_became_peered":"2024-09-13T18:15:06.044485+0000","last_unstale":"2024-09-13T18:16:09.036030+0000","last_undegraded":"2024-09-13T18:16:09.036030+0000","last_fullsized":"2024-09-13T18:16:09.036030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:25.622237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035351+0000","last_change":"2024-09-13T18:15:06.030149+0000","last_active":"2024-09-13T18:16:09.035351+0000","last_peered":"2024-09-13T18:16:09.035351+0000","last_clean":"2024-09-13T18:16:09.035351+0000","last_became_active":"2024-09-13T18:15:06.029830+0000","last_became_peered":"2024-09-13T18:15:06.029830+0000","last_unstale":"2024-09-13T18:16:09.035351+0000","last_undegraded":"2024-09-13T18:16:09.035351+0000","last_fullsized":"2024-09-13T18:16:09.035351+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:37.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036712+0000","last_change":"2024-09-13T18:15:06.032485+0000","last_active":"2024-09-13T18:16:09.036712+0000","last_peered":"2024-09-13T18:16:09.036712+0000","last_clean":"2024-09-13T18:16:09.036712+0000","last_became_active":"2024-09-13T18:15:06.032041+0000","last_became_peered":"2024-09-13T18:15:06.032041+0000","last_unstale":"2024-09-13T18:16:09.036712+0000","last_undegraded":"2024-09-13T18:16:09.036712+0000","last_fullsized":"2024-09-13T18:16:09.036712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:09.793771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038760+0000","last_change":"2024-09-13T18:15:06.020133+0000","last_active":"2024-09-13T18:16:09.038760+0000","last_peered":"2024-09-13T18:16:09.038760+0000","last_clean":"2024-09-13T18:16:09.038760+0000","last_became_active":"2024-09-13T18:15:06.019829+0000","last_became_peered":"2024-09-13T18:15:06.019829+0000","last_unstale":"2024-09-13T18:16:09.038760+0000","last_undegraded":"2024-09-13T18:16:09.038760+0000","last_fullsized":"2024-09-13T18:16:09.038760+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:27.635560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037811+0000","last_change":"2024-09-13T18:15:06.026796+0000","last_active":"2024-09-13T18:16:09.037811+0000","last_peered":"2024-09-13T18:16:09.037811+0000","last_clean":"2024-09-13T18:16:09.037811+0000","last_became_active":"2024-09-13T18:15:06.026449+0000","last_became_peered":"2024-09-13T18:15:06.026449+0000","last_unstale":"2024-09-13T18:16:09.037811+0000","last_undegraded":"2024-09-13T18:16:09.037811+0000","last_fullsized":"2024-09-13T18:16:09.037811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:09.825997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036519+0000","last_change":"2024-09-13T18:15:06.019787+0000","last_active":"2024-09-13T18:16:09.036519+0000","last_peered":"2024-09-13T18:16:09.036519+0000","last_clean":"2024-09-13T18:16:09.036519+0000","last_became_active":"2024-09-13T18:15:06.019514+0000","last_became_peered":"2024-09-13T18:15:06.019514+0000","last_unstale":"2024-09-13T18:16:09.036519+0000","last_undegraded":"2024-09-13T18:16:09.036519+0000","last_fullsized":"2024-09-13T18:16:09.036519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:05.614832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038403+0000","last_change":"2024-09-13T18:15:06.024397+0000","last_active":"2024-09-13T18:16:09.038403+0000","last_peered":"2024-09-13T18:16:09.038403+0000","last_clean":"2024-09-13T18:16:09.038403+0000","last_became_active":"2024-09-13T18:15:06.024089+0000","last_became_peered":"2024-09-13T18:15:06.024089+0000","last_unstale":"2024-09-13T18:16:09.038403+0000","last_undegraded":"2024-09-13T18:16:09.038403+0000","last_fullsized":"2024-09-13T18:16:09.038403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:42.590652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035761+0000","last_change":"2024-09-13T18:15:06.045070+0000","last_active":"2024-09-13T18:16:09.035761+0000","last_peered":"2024-09-13T18:16:09.035761+0000","last_clean":"2024-09-13T18:16:09.035761+0000","last_became_active":"2024-09-13T18:15:06.044098+0000","last_became_peered":"2024-09-13T18:15:06.044098+0000","last_unstale":"2024-09-13T18:16:09.035761+0000","last_undegraded":"2024-09-13T18:16:09.035761+0000","last_fullsized":"2024-09-13T18:16:09.035761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:53.943354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032289+0000","last_change":"2024-09-13T18:15:06.038938+0000","last_active":"2024-09-13T18:16:09.032289+0000","last_peered":"2024-09-13T18:16:09.032289+0000","last_clean":"2024-09-13T18:16:09.032289+0000","last_became_active":"2024-09-13T18:15:06.038432+0000","last_became_peered":"2024-09-13T18:15:06.038432+0000","last_unstale":"2024-09-13T18:16:09.032289+0000","last_undegraded":"2024-09-13T18:16:09.032289+0000","last_fullsized":"2024-09-13T18:16:09.032289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:18.339859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035820+0000","last_change":"2024-09-13T18:15:06.044302+0000","last_active":"2024-09-13T18:16:09.035820+0000","last_peered":"2024-09-13T18:16:09.035820+0000","last_clean":"2024-09-13T18:16:09.035820+0000","last_became_active":"2024-09-13T18:15:06.043959+0000","last_became_peered":"2024-09-13T18:15:06.043959+0000","last_unstale":"2024-09-13T18:16:09.035820+0000","last_undegraded":"2024-09-13T18:16:09.035820+0000","last_fullsized":"2024-09-13T18:16:09.035820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:06.271075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.168592+0000","last_change":"2024-09-13T18:16:10.168592+0000","last_active":"2024-09-13T18:16:10.168592+0000","last_peered":"2024-09-13T18:16:10.168592+0000","last_clean":"2024-09-13T18:16:10.168592+0000","last_became_active":"2024-09-13T18:16:10.168248+0000","last_became_peered":"2024-09-13T18:16:10.168248+0000","last_unstale":"2024-09-13T18:16:10.168592+0000","last_undegraded":"2024-09-13T18:16:10.168592+0000","last_fullsized":"2024-09-13T18:16:10.168592+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:07.267979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038232+0000","last_change":"2024-09-13T18:15:06.023969+0000","last_active":"2024-09-13T18:16:09.038232+0000","last_peered":"2024-09-13T18:16:09.038232+0000","last_clean":"2024-09-13T18:16:09.038232+0000","last_became_active":"2024-09-13T18:15:06.023641+0000","last_became_peered":"2024-09-13T18:15:06.023641+0000","last_unstale":"2024-09-13T18:16:09.038232+0000","last_undegraded":"2024-09-13T18:16:09.038232+0000","last_fullsized":"2024-09-13T18:16:09.038232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:27.188715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034464+0000","last_change":"2024-09-13T18:15:06.021576+0000","last_active":"2024-09-13T18:16:09.034464+0000","last_peered":"2024-09-13T18:16:09.034464+0000","last_clean":"2024-09-13T18:16:09.034464+0000","last_became_active":"2024-09-13T18:15:06.018911+0000","last_became_peered":"2024-09-13T18:15:06.018911+0000","last_unstale":"2024-09-13T18:16:09.034464+0000","last_undegraded":"2024-09-13T18:16:09.034464+0000","last_fullsized":"2024-09-13T18:16:09.034464+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:04.669568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:26.821325+0000","last_change":"2024-09-13T18:15:05.568259+0000","last_active":"2024-09-13T18:16:26.821325+0000","last_peered":"2024-09-13T18:16:26.821325+0000","last_clean":"2024-09-13T18:16:26.821325+0000","last_became_active":"2024-09-13T18:15:05.567888+0000","last_became_peered":"2024-09-13T18:15:05.567888+0000","last_unstale":"2024-09-13T18:16:26.821325+0000","last_undegraded":"2024-09-13T18:16:26.821325+0000","last_fullsized":"2024-09-13T18:16:26.821325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:50.942167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039111+0000","last_change":"2024-09-13T18:15:06.025868+0000","last_active":"2024-09-13T18:16:09.039111+0000","last_peered":"2024-09-13T18:16:09.039111+0000","last_clean":"2024-09-13T18:16:09.039111+0000","last_became_active":"2024-09-13T18:15:06.025583+0000","last_became_peered":"2024-09-13T18:15:06.025583+0000","last_unstale":"2024-09-13T18:16:09.039111+0000","last_undegraded":"2024-09-13T18:16:09.039111+0000","last_fullsized":"2024-09-13T18:16:09.039111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:15.774579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274650+0000","last_change":"2024-09-13T18:15:05.570260+0000","last_active":"2024-09-13T18:16:09.274650+0000","last_peered":"2024-09-13T18:16:09.274650+0000","last_clean":"2024-09-13T18:16:09.274650+0000","last_became_active":"2024-09-13T18:15:05.569942+0000","last_became_peered":"2024-09-13T18:15:05.569942+0000","last_unstale":"2024-09-13T18:16:09.274650+0000","last_undegraded":"2024-09-13T18:16:09.274650+0000","last_fullsized":"2024-09-13T18:16:09.274650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:24.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036117+0000","last_change":"2024-09-13T18:15:05.568010+0000","last_active":"2024-09-13T18:16:09.036117+0000","last_peered":"2024-09-13T18:16:09.036117+0000","last_clean":"2024-09-13T18:16:09.036117+0000","last_became_active":"2024-09-13T18:15:05.567415+0000","last_became_peered":"2024-09-13T18:15:05.567415+0000","last_unstale":"2024-09-13T18:16:09.036117+0000","last_undegraded":"2024-09-13T18:16:09.036117+0000","last_fullsized":"2024-09-13T18:16:09.036117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:26.873148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036995+0000","last_change":"2024-09-13T18:15:06.034747+0000","last_active":"2024-09-13T18:16:09.036995+0000","last_peered":"2024-09-13T18:16:09.036995+0000","last_clean":"2024-09-13T18:16:09.036995+0000","last_became_active":"2024-09-13T18:15:06.034471+0000","last_became_peered":"2024-09-13T18:15:06.034471+0000","last_unstale":"2024-09-13T18:16:09.036995+0000","last_undegraded":"2024-09-13T18:16:09.036995+0000","last_fullsized":"2024-09-13T18:16:09.036995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:25.493842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038865+0000","last_change":"2024-09-13T18:15:05.562831+0000","last_active":"2024-09-13T18:16:09.038865+0000","last_peered":"2024-09-13T18:16:09.038865+0000","last_clean":"2024-09-13T18:16:09.038865+0000","last_became_active":"2024-09-13T18:15:05.562530+0000","last_became_peered":"2024-09-13T18:15:05.562530+0000","last_unstale":"2024-09-13T18:16:09.038865+0000","last_undegraded":"2024-09-13T18:16:09.038865+0000","last_fullsized":"2024-09-13T18:16:09.038865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:00.696204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040311+0000","last_change":"2024-09-13T18:15:06.019843+0000","last_active":"2024-09-13T18:16:09.040311+0000","last_peered":"2024-09-13T18:16:09.040311+0000","last_clean":"2024-09-13T18:16:09.040311+0000","last_became_active":"2024-09-13T18:15:06.019210+0000","last_became_peered":"2024-09-13T18:15:06.019210+0000","last_unstale":"2024-09-13T18:16:09.040311+0000","last_undegraded":"2024-09-13T18:16:09.040311+0000","last_fullsized":"2024-09-13T18:16:09.040311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:51:05.552674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:26.820758+0000","last_change":"2024-09-13T18:15:05.567185+0000","last_active":"2024-09-13T18:16:26.820758+0000","last_peered":"2024-09-13T18:16:26.820758+0000","last_clean":"2024-09-13T18:16:26.820758+0000","last_became_active":"2024-09-13T18:15:05.566489+0000","last_became_peered":"2024-09-13T18:15:05.566489+0000","last_unstale":"2024-09-13T18:16:26.820758+0000","last_undegraded":"2024-09-13T18:16:26.820758+0000","last_fullsized":"2024-09-13T18:16:26.820758+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:57.976621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035208+0000","last_change":"2024-09-13T18:15:06.021551+0000","last_active":"2024-09-13T18:16:09.035208+0000","last_peered":"2024-09-13T18:16:09.035208+0000","last_clean":"2024-09-13T18:16:09.035208+0000","last_became_active":"2024-09-13T18:15:06.021097+0000","last_became_peered":"2024-09-13T18:15:06.021097+0000","last_unstale":"2024-09-13T18:16:09.035208+0000","last_undegraded":"2024-09-13T18:16:09.035208+0000","last_fullsized":"2024-09-13T18:16:09.035208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:06.392812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036410+0000","last_change":"2024-09-13T18:15:05.567190+0000","last_active":"2024-09-13T18:16:09.036410+0000","last_peered":"2024-09-13T18:16:09.036410+0000","last_clean":"2024-09-13T18:16:09.036410+0000","last_became_active":"2024-09-13T18:15:05.566877+0000","last_became_peered":"2024-09-13T18:15:05.566877+0000","last_unstale":"2024-09-13T18:16:09.036410+0000","last_undegraded":"2024-09-13T18:16:09.036410+0000","last_fullsized":"2024-09-13T18:16:09.036410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:59.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032474+0000","last_change":"2024-09-13T18:15:06.031161+0000","last_active":"2024-09-13T18:16:09.032474+0000","last_peered":"2024-09-13T18:16:09.032474+0000","last_clean":"2024-09-13T18:16:09.032474+0000","last_became_active":"2024-09-13T18:15:06.030863+0000","last_became_peered":"2024-09-13T18:15:06.030863+0000","last_unstale":"2024-09-13T18:16:09.032474+0000","last_undegraded":"2024-09-13T18:16:09.032474+0000","last_fullsized":"2024-09-13T18:16:09.032474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:08.786051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039357+0000","last_change":"2024-09-13T18:15:05.579918+0000","last_active":"2024-09-13T18:16:09.039357+0000","last_peered":"2024-09-13T18:16:09.039357+0000","last_clean":"2024-09-13T18:16:09.039357+0000","last_became_active":"2024-09-13T18:15:05.579542+0000","last_became_peered":"2024-09-13T18:15:05.579542+0000","last_unstale":"2024-09-13T18:16:09.039357+0000","last_undegraded":"2024-09-13T18:16:09.039357+0000","last_fullsized":"2024-09-13T18:16:09.039357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:11.000542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.042689+0000","last_change":"2024-09-13T18:16:10.042689+0000","last_active":"2024-09-13T18:16:10.042689+0000","last_peered":"2024-09-13T18:16:10.042689+0000","last_clean":"2024-09-13T18:16:10.042689+0000","last_became_active":"2024-09-13T18:16:10.042270+0000","last_became_peered":"2024-09-13T18:16:10.042270+0000","last_unstale":"2024-09-13T18:16:10.042689+0000","last_undegraded":"2024-09-13T18:16:10.042689+0000","last_fullsized":"2024-09-13T18:16:10.042689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:48.747673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":202,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:26.820901+0000","last_change":"2024-09-13T18:15:05.569168+0000","last_active":"2024-09-13T18:16:26.820901+0000","last_peered":"2024-09-13T18:16:26.820901+0000","last_clean":"2024-09-13T18:16:26.820901+0000","last_became_active":"2024-09-13T18:15:05.568816+0000","last_became_peered":"2024-09-13T18:15:05.568816+0000","last_unstale":"2024-09-13T18:16:26.820901+0000","last_undegraded":"2024-09-13T18:16:26.820901+0000","last_fullsized":"2024-09-13T18:16:26.820901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:33.113730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60999,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":157,"num_read_kb":138,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034704+0000","last_change":"2024-09-13T18:15:06.022452+0000","last_active":"2024-09-13T18:16:09.034704+0000","last_peered":"2024-09-13T18:16:09.034704+0000","last_clean":"2024-09-13T18:16:09.034704+0000","last_became_active":"2024-09-13T18:15:06.022167+0000","last_became_peered":"2024-09-13T18:15:06.022167+0000","last_unstale":"2024-09-13T18:16:09.034704+0000","last_undegraded":"2024-09-13T18:16:09.034704+0000","last_fullsized":"2024-09-13T18:16:09.034704+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.389512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036514+0000","last_change":"2024-09-13T18:15:05.575305+0000","last_active":"2024-09-13T18:16:09.036514+0000","last_peered":"2024-09-13T18:16:09.036514+0000","last_clean":"2024-09-13T18:16:09.036514+0000","last_became_active":"2024-09-13T18:15:05.575023+0000","last_became_peered":"2024-09-13T18:15:05.575023+0000","last_unstale":"2024-09-13T18:16:09.036514+0000","last_undegraded":"2024-09-13T18:16:09.036514+0000","last_fullsized":"2024-09-13T18:16:09.036514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.098264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035497+0000","last_change":"2024-09-13T18:15:06.042275+0000","last_active":"2024-09-13T18:16:09.035497+0000","last_peered":"2024-09-13T18:16:09.035497+0000","last_clean":"2024-09-13T18:16:09.035497+0000","last_became_active":"2024-09-13T18:15:06.041593+0000","last_became_peered":"2024-09-13T18:15:06.041593+0000","last_unstale":"2024-09-13T18:16:09.035497+0000","last_undegraded":"2024-09-13T18:16:09.035497+0000","last_fullsized":"2024-09-13T18:16:09.035497+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.550068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039122+0000","last_change":"2024-09-13T18:15:05.569419+0000","last_active":"2024-09-13T18:16:09.039122+0000","last_peered":"2024-09-13T18:16:09.039122+0000","last_clean":"2024-09-13T18:16:09.039122+0000","last_became_active":"2024-09-13T18:15:05.569126+0000","last_became_peered":"2024-09-13T18:15:05.569126+0000","last_unstale":"2024-09-13T18:16:09.039122+0000","last_undegraded":"2024-09-13T18:16:09.039122+0000","last_fullsized":"2024-09-13T18:16:09.039122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:17.133139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.041737+0000","last_change":"2024-09-13T18:16:10.041737+0000","last_active":"2024-09-13T18:16:10.041737+0000","last_peered":"2024-09-13T18:16:10.041737+0000","last_clean":"2024-09-13T18:16:10.041737+0000","last_became_active":"2024-09-13T18:16:10.041356+0000","last_became_peered":"2024-09-13T18:16:10.041356+0000","last_unstale":"2024-09-13T18:16:10.041737+0000","last_undegraded":"2024-09-13T18:16:10.041737+0000","last_fullsized":"2024-09-13T18:16:10.041737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:29.883598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:24.818460+0000","last_change":"2024-09-13T18:15:05.564102+0000","last_active":"2024-09-13T18:16:24.818460+0000","last_peered":"2024-09-13T18:16:24.818460+0000","last_clean":"2024-09-13T18:16:24.818460+0000","last_became_active":"2024-09-13T18:15:05.563784+0000","last_became_peered":"2024-09-13T18:15:05.563784+0000","last_unstale":"2024-09-13T18:16:24.818460+0000","last_undegraded":"2024-09-13T18:16:24.818460+0000","last_fullsized":"2024-09-13T18:16:24.818460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:38.285940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035741+0000","last_change":"2024-09-13T18:15:06.021229+0000","last_active":"2024-09-13T18:16:09.035741+0000","last_peered":"2024-09-13T18:16:09.035741+0000","last_clean":"2024-09-13T18:16:09.035741+0000","last_became_active":"2024-09-13T18:15:06.021010+0000","last_became_peered":"2024-09-13T18:15:06.021010+0000","last_unstale":"2024-09-13T18:16:09.035741+0000","last_undegraded":"2024-09-13T18:16:09.035741+0000","last_fullsized":"2024-09-13T18:16:09.035741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:32.149865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.180279+0000","last_change":"2024-09-13T18:16:10.180279+0000","last_active":"2024-09-13T18:16:10.180279+0000","last_peered":"2024-09-13T18:16:10.180279+0000","last_clean":"2024-09-13T18:16:10.180279+0000","last_became_active":"2024-09-13T18:16:10.169311+0000","last_became_peered":"2024-09-13T18:16:10.169311+0000","last_unstale":"2024-09-13T18:16:10.180279+0000","last_undegraded":"2024-09-13T18:16:10.180279+0000","last_fullsized":"2024-09-13T18:16:10.180279+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:42.156806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039327+0000","last_change":"2024-09-13T18:15:06.027258+0000","last_active":"2024-09-13T18:16:09.039327+0000","last_peered":"2024-09-13T18:16:09.039327+0000","last_clean":"2024-09-13T18:16:09.039327+0000","last_became_active":"2024-09-13T18:15:06.026947+0000","last_became_peered":"2024-09-13T18:15:06.026947+0000","last_unstale":"2024-09-13T18:16:09.039327+0000","last_undegraded":"2024-09-13T18:16:09.039327+0000","last_fullsized":"2024-09-13T18:16:09.039327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:05.227479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034859+0000","last_change":"2024-09-13T18:15:05.561141+0000","last_active":"2024-09-13T18:16:09.034859+0000","last_peered":"2024-09-13T18:16:09.034859+0000","last_clean":"2024-09-13T18:16:09.034859+0000","last_became_active":"2024-09-13T18:15:05.560824+0000","last_became_peered":"2024-09-13T18:15:05.560824+0000","last_unstale":"2024-09-13T18:16:09.034859+0000","last_undegraded":"2024-09-13T18:16:09.034859+0000","last_fullsized":"2024-09-13T18:16:09.034859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:46.213439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038234+0000","last_change":"2024-09-13T18:15:06.020893+0000","last_active":"2024-09-13T18:16:09.038234+0000","last_peered":"2024-09-13T18:16:09.038234+0000","last_clean":"2024-09-13T18:16:09.038234+0000","last_became_active":"2024-09-13T18:15:06.020586+0000","last_became_peered":"2024-09-13T18:15:06.020586+0000","last_unstale":"2024-09-13T18:16:09.038234+0000","last_undegraded":"2024-09-13T18:16:09.038234+0000","last_fullsized":"2024-09-13T18:16:09.038234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:53.793895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035771+0000","last_change":"2024-09-13T18:15:05.571263+0000","last_active":"2024-09-13T18:16:09.035771+0000","last_peered":"2024-09-13T18:16:09.035771+0000","last_clean":"2024-09-13T18:16:09.035771+0000","last_became_active":"2024-09-13T18:15:05.570520+0000","last_became_peered":"2024-09-13T18:15:05.570520+0000","last_unstale":"2024-09-13T18:16:09.035771+0000","last_undegraded":"2024-09-13T18:16:09.035771+0000","last_fullsized":"2024-09-13T18:16:09.035771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:52.401456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036628+0000","last_change":"2024-09-13T18:15:06.021756+0000","last_active":"2024-09-13T18:16:09.036628+0000","last_peered":"2024-09-13T18:16:09.036628+0000","last_clean":"2024-09-13T18:16:09.036628+0000","last_became_active":"2024-09-13T18:15:06.021398+0000","last_became_peered":"2024-09-13T18:15:06.021398+0000","last_unstale":"2024-09-13T18:16:09.036628+0000","last_undegraded":"2024-09-13T18:16:09.036628+0000","last_fullsized":"2024-09-13T18:16:09.036628+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:25.227069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039486+0000","last_change":"2024-09-13T18:15:05.570164+0000","last_active":"2024-09-13T18:16:09.039486+0000","last_peered":"2024-09-13T18:16:09.039486+0000","last_clean":"2024-09-13T18:16:09.039486+0000","last_became_active":"2024-09-13T18:15:05.569799+0000","last_became_peered":"2024-09-13T18:15:05.569799+0000","last_unstale":"2024-09-13T18:16:09.039486+0000","last_undegraded":"2024-09-13T18:16:09.039486+0000","last_fullsized":"2024-09-13T18:16:09.039486+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:07.623426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035703+0000","last_change":"2024-09-13T18:15:06.024555+0000","last_active":"2024-09-13T18:16:09.035703+0000","last_peered":"2024-09-13T18:16:09.035703+0000","last_clean":"2024-09-13T18:16:09.035703+0000","last_became_active":"2024-09-13T18:15:06.023855+0000","last_became_peered":"2024-09-13T18:15:06.023855+0000","last_unstale":"2024-09-13T18:16:09.035703+0000","last_undegraded":"2024-09-13T18:16:09.035703+0000","last_fullsized":"2024-09-13T18:16:09.035703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:04.790167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:23.817270+0000","last_change":"2024-09-13T18:15:05.578930+0000","last_active":"2024-09-13T18:16:23.817270+0000","last_peered":"2024-09-13T18:16:23.817270+0000","last_clean":"2024-09-13T18:16:23.817270+0000","last_became_active":"2024-09-13T18:15:05.578597+0000","last_became_peered":"2024-09-13T18:15:05.578597+0000","last_unstale":"2024-09-13T18:16:23.817270+0000","last_undegraded":"2024-09-13T18:16:23.817270+0000","last_fullsized":"2024-09-13T18:16:23.817270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:45.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036509+0000","last_change":"2024-09-13T18:15:06.025762+0000","last_active":"2024-09-13T18:16:09.036509+0000","last_peered":"2024-09-13T18:16:09.036509+0000","last_clean":"2024-09-13T18:16:09.036509+0000","last_became_active":"2024-09-13T18:15:06.025523+0000","last_became_peered":"2024-09-13T18:15:06.025523+0000","last_unstale":"2024-09-13T18:16:09.036509+0000","last_undegraded":"2024-09-13T18:16:09.036509+0000","last_fullsized":"2024-09-13T18:16:09.036509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:21.430133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":328,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035851+0000","last_change":"2024-09-13T18:13:55.705797+0000","last_active":"2024-09-13T18:16:09.035851+0000","last_peered":"2024-09-13T18:16:09.035851+0000","last_clean":"2024-09-13T18:16:09.035851+0000","last_became_active":"2024-09-13T18:13:55.705398+0000","last_became_peered":"2024-09-13T18:13:55.705398+0000","last_unstale":"2024-09-13T18:16:09.035851+0000","last_undegraded":"2024-09-13T18:16:09.035851+0000","last_fullsized":"2024-09-13T18:16:09.035851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:10:37.078709+0000","last_clean_scrub_stamp":"2024-09-13T18:10:37.078709+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:10.923431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.033277+0000","last_change":"2024-09-13T18:15:05.561809+0000","last_active":"2024-09-13T18:16:09.033277+0000","last_peered":"2024-09-13T18:16:09.033277+0000","last_clean":"2024-09-13T18:16:09.033277+0000","last_became_active":"2024-09-13T18:15:05.561493+0000","last_became_peered":"2024-09-13T18:15:05.561493+0000","last_unstale":"2024-09-13T18:16:09.033277+0000","last_undegraded":"2024-09-13T18:16:09.033277+0000","last_fullsized":"2024-09-13T18:16:09.033277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.166893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.169056+0000","last_change":"2024-09-13T18:16:10.168532+0000","last_active":"2024-09-13T18:16:10.169056+0000","last_peered":"2024-09-13T18:16:10.169056+0000","last_clean":"2024-09-13T18:16:10.169056+0000","last_became_active":"2024-09-13T18:16:10.168150+0000","last_became_peered":"2024-09-13T18:16:10.168150+0000","last_unstale":"2024-09-13T18:16:10.169056+0000","last_undegraded":"2024-09-13T18:16:10.169056+0000","last_fullsized":"2024-09-13T18:16:10.169056+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:11.538267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035799+0000","last_change":"2024-09-13T18:15:05.564512+0000","last_active":"2024-09-13T18:16:09.035799+0000","last_peered":"2024-09-13T18:16:09.035799+0000","last_clean":"2024-09-13T18:16:09.035799+0000","last_became_active":"2024-09-13T18:15:05.561695+0000","last_became_peered":"2024-09-13T18:15:05.561695+0000","last_unstale":"2024-09-13T18:16:09.035799+0000","last_undegraded":"2024-09-13T18:16:09.035799+0000","last_fullsized":"2024-09-13T18:16:09.035799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:45.537500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035512+0000","last_change":"2024-09-13T18:15:06.034056+0000","last_active":"2024-09-13T18:16:09.035512+0000","last_peered":"2024-09-13T18:16:09.035512+0000","last_clean":"2024-09-13T18:16:09.035512+0000","last_became_active":"2024-09-13T18:15:06.030633+0000","last_became_peered":"2024-09-13T18:15:06.030633+0000","last_unstale":"2024-09-13T18:16:09.035512+0000","last_undegraded":"2024-09-13T18:16:09.035512+0000","last_fullsized":"2024-09-13T18:16:09.035512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:58.462828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:23.816779+0000","last_change":"2024-09-13T18:15:05.576585+0000","last_active":"2024-09-13T18:16:23.816779+0000","last_peered":"2024-09-13T18:16:23.816779+0000","last_clean":"2024-09-13T18:16:23.816779+0000","last_became_active":"2024-09-13T18:15:05.576056+0000","last_became_peered":"2024-09-13T18:15:05.576056+0000","last_unstale":"2024-09-13T18:16:23.816779+0000","last_undegraded":"2024-09-13T18:16:23.816779+0000","last_fullsized":"2024-09-13T18:16:23.816779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:25.419342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038833+0000","last_change":"2024-09-13T18:15:06.028288+0000","last_active":"2024-09-13T18:16:09.038833+0000","last_peered":"2024-09-13T18:16:09.038833+0000","last_clean":"2024-09-13T18:16:09.038833+0000","last_became_active":"2024-09-13T18:15:06.028002+0000","last_became_peered":"2024-09-13T18:15:06.028002+0000","last_unstale":"2024-09-13T18:16:09.038833+0000","last_undegraded":"2024-09-13T18:16:09.038833+0000","last_fullsized":"2024-09-13T18:16:09.038833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.258724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:26.820759+0000","last_change":"2024-09-13T18:15:05.567336+0000","last_active":"2024-09-13T18:16:26.820759+0000","last_peered":"2024-09-13T18:16:26.820759+0000","last_clean":"2024-09-13T18:16:26.820759+0000","last_became_active":"2024-09-13T18:15:05.567050+0000","last_became_peered":"2024-09-13T18:15:05.567050+0000","last_unstale":"2024-09-13T18:16:26.820759+0000","last_undegraded":"2024-09-13T18:16:26.820759+0000","last_fullsized":"2024-09-13T18:16:26.820759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:50.016671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274715+0000","last_change":"2024-09-13T18:15:06.038088+0000","last_active":"2024-09-13T18:16:09.274715+0000","last_peered":"2024-09-13T18:16:09.274715+0000","last_clean":"2024-09-13T18:16:09.274715+0000","last_became_active":"2024-09-13T18:15:06.037686+0000","last_became_peered":"2024-09-13T18:15:06.037686+0000","last_unstale":"2024-09-13T18:16:09.274715+0000","last_undegraded":"2024-09-13T18:16:09.274715+0000","last_fullsized":"2024-09-13T18:16:09.274715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:50.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040334+0000","last_change":"2024-09-13T18:15:05.572920+0000","last_active":"2024-09-13T18:16:09.040334+0000","last_peered":"2024-09-13T18:16:09.040334+0000","last_clean":"2024-09-13T18:16:09.040334+0000","last_became_active":"2024-09-13T18:15:05.572611+0000","last_became_peered":"2024-09-13T18:15:05.572611+0000","last_unstale":"2024-09-13T18:16:09.040334+0000","last_undegraded":"2024-09-13T18:16:09.040334+0000","last_fullsized":"2024-09-13T18:16:09.040334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:35.017695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.274838+0000","last_change":"2024-09-13T18:15:06.035681+0000","last_active":"2024-09-13T18:16:09.274838+0000","last_peered":"2024-09-13T18:16:09.274838+0000","last_clean":"2024-09-13T18:16:09.274838+0000","last_became_active":"2024-09-13T18:15:06.035353+0000","last_became_peered":"2024-09-13T18:15:06.035353+0000","last_unstale":"2024-09-13T18:16:09.274838+0000","last_undegraded":"2024-09-13T18:16:09.274838+0000","last_fullsized":"2024-09-13T18:16:09.274838+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:09.781692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035971+0000","last_change":"2024-09-13T18:15:05.578107+0000","last_active":"2024-09-13T18:16:09.035971+0000","last_peered":"2024-09-13T18:16:09.035971+0000","last_clean":"2024-09-13T18:16:09.035971+0000","last_became_active":"2024-09-13T18:15:05.577777+0000","last_became_peered":"2024-09-13T18:15:05.577777+0000","last_unstale":"2024-09-13T18:16:09.035971+0000","last_undegraded":"2024-09-13T18:16:09.035971+0000","last_fullsized":"2024-09-13T18:16:09.035971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:37.573332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035833+0000","last_change":"2024-09-13T18:15:06.034893+0000","last_active":"2024-09-13T18:16:09.035833+0000","last_peered":"2024-09-13T18:16:09.035833+0000","last_clean":"2024-09-13T18:16:09.035833+0000","last_became_active":"2024-09-13T18:15:06.034421+0000","last_became_peered":"2024-09-13T18:15:06.034421+0000","last_unstale":"2024-09-13T18:16:09.035833+0000","last_undegraded":"2024-09-13T18:16:09.035833+0000","last_fullsized":"2024-09-13T18:16:09.035833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:23.614971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.040481+0000","last_change":"2024-09-13T18:15:05.561912+0000","last_active":"2024-09-13T18:16:09.040481+0000","last_peered":"2024-09-13T18:16:09.040481+0000","last_clean":"2024-09-13T18:16:09.040481+0000","last_became_active":"2024-09-13T18:15:05.561573+0000","last_became_peered":"2024-09-13T18:15:05.561573+0000","last_unstale":"2024-09-13T18:16:09.040481+0000","last_undegraded":"2024-09-13T18:16:09.040481+0000","last_fullsized":"2024-09-13T18:16:09.040481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:06.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037867+0000","last_change":"2024-09-13T18:15:06.023273+0000","last_active":"2024-09-13T18:16:09.037867+0000","last_peered":"2024-09-13T18:16:09.037867+0000","last_clean":"2024-09-13T18:16:09.037867+0000","last_became_active":"2024-09-13T18:15:06.022980+0000","last_became_peered":"2024-09-13T18:15:06.022980+0000","last_unstale":"2024-09-13T18:16:09.037867+0000","last_undegraded":"2024-09-13T18:16:09.037867+0000","last_fullsized":"2024-09-13T18:16:09.037867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:40.966317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034490+0000","last_change":"2024-09-13T18:15:05.568210+0000","last_active":"2024-09-13T18:16:09.034490+0000","last_peered":"2024-09-13T18:16:09.034490+0000","last_clean":"2024-09-13T18:16:09.034490+0000","last_became_active":"2024-09-13T18:15:05.567881+0000","last_became_peered":"2024-09-13T18:15:05.567881+0000","last_unstale":"2024-09-13T18:16:09.034490+0000","last_undegraded":"2024-09-13T18:16:09.034490+0000","last_fullsized":"2024-09-13T18:16:09.034490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:06.808041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.155432+0000","last_change":"2024-09-13T18:16:10.155432+0000","last_active":"2024-09-13T18:16:10.155432+0000","last_peered":"2024-09-13T18:16:10.155432+0000","last_clean":"2024-09-13T18:16:10.155432+0000","last_became_active":"2024-09-13T18:16:10.154963+0000","last_became_peered":"2024-09-13T18:16:10.154963+0000","last_unstale":"2024-09-13T18:16:10.155432+0000","last_undegraded":"2024-09-13T18:16:10.155432+0000","last_fullsized":"2024-09-13T18:16:10.155432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:28.992501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.044560+0000","last_change":"2024-09-13T18:16:10.044560+0000","last_active":"2024-09-13T18:16:10.044560+0000","last_peered":"2024-09-13T18:16:10.044560+0000","last_clean":"2024-09-13T18:16:10.044560+0000","last_became_active":"2024-09-13T18:16:10.041701+0000","last_became_peered":"2024-09-13T18:16:10.041701+0000","last_unstale":"2024-09-13T18:16:10.044560+0000","last_undegraded":"2024-09-13T18:16:10.044560+0000","last_fullsized":"2024-09-13T18:16:10.044560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:15.058915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034283+0000","last_change":"2024-09-13T18:15:06.022444+0000","last_active":"2024-09-13T18:16:09.034283+0000","last_peered":"2024-09-13T18:16:09.034283+0000","last_clean":"2024-09-13T18:16:09.034283+0000","last_became_active":"2024-09-13T18:15:06.022134+0000","last_became_peered":"2024-09-13T18:15:06.022134+0000","last_unstale":"2024-09-13T18:16:09.034283+0000","last_undegraded":"2024-09-13T18:16:09.034283+0000","last_fullsized":"2024-09-13T18:16:09.034283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:36.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036848+0000","last_change":"2024-09-13T18:15:05.559112+0000","last_active":"2024-09-13T18:16:09.036848+0000","last_peered":"2024-09-13T18:16:09.036848+0000","last_clean":"2024-09-13T18:16:09.036848+0000","last_became_active":"2024-09-13T18:15:05.558757+0000","last_became_peered":"2024-09-13T18:15:05.558757+0000","last_unstale":"2024-09-13T18:16:09.036848+0000","last_undegraded":"2024-09-13T18:16:09.036848+0000","last_fullsized":"2024-09-13T18:16:09.036848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:57.691324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.038322+0000","last_change":"2024-09-13T18:15:06.032621+0000","last_active":"2024-09-13T18:16:09.038322+0000","last_peered":"2024-09-13T18:16:09.038322+0000","last_clean":"2024-09-13T18:16:09.038322+0000","last_became_active":"2024-09-13T18:15:06.032321+0000","last_became_peered":"2024-09-13T18:15:06.032321+0000","last_unstale":"2024-09-13T18:16:09.038322+0000","last_undegraded":"2024-09-13T18:16:09.038322+0000","last_fullsized":"2024-09-13T18:16:09.038322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:59.695094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035931+0000","last_change":"2024-09-13T18:15:05.571633+0000","last_active":"2024-09-13T18:16:09.035931+0000","last_peered":"2024-09-13T18:16:09.035931+0000","last_clean":"2024-09-13T18:16:09.035931+0000","last_became_active":"2024-09-13T18:15:05.571292+0000","last_became_peered":"2024-09-13T18:15:05.571292+0000","last_unstale":"2024-09-13T18:16:09.035931+0000","last_undegraded":"2024-09-13T18:16:09.035931+0000","last_fullsized":"2024-09-13T18:16:09.035931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.452906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037398+0000","last_change":"2024-09-13T18:15:06.045725+0000","last_active":"2024-09-13T18:16:09.037398+0000","last_peered":"2024-09-13T18:16:09.037398+0000","last_clean":"2024-09-13T18:16:09.037398+0000","last_became_active":"2024-09-13T18:15:06.045401+0000","last_became_peered":"2024-09-13T18:15:06.045401+0000","last_unstale":"2024-09-13T18:16:09.037398+0000","last_undegraded":"2024-09-13T18:16:09.037398+0000","last_fullsized":"2024-09-13T18:16:09.037398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:30.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034531+0000","last_change":"2024-09-13T18:15:05.567295+0000","last_active":"2024-09-13T18:16:09.034531+0000","last_peered":"2024-09-13T18:16:09.034531+0000","last_clean":"2024-09-13T18:16:09.034531+0000","last_became_active":"2024-09-13T18:15:05.566992+0000","last_became_peered":"2024-09-13T18:15:05.566992+0000","last_unstale":"2024-09-13T18:16:09.034531+0000","last_undegraded":"2024-09-13T18:16:09.034531+0000","last_fullsized":"2024-09-13T18:16:09.034531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:27.596525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.036188+0000","last_change":"2024-09-13T18:15:06.036750+0000","last_active":"2024-09-13T18:16:09.036188+0000","last_peered":"2024-09-13T18:16:09.036188+0000","last_clean":"2024-09-13T18:16:09.036188+0000","last_became_active":"2024-09-13T18:15:06.036424+0000","last_became_peered":"2024-09-13T18:15:06.036424+0000","last_unstale":"2024-09-13T18:16:09.036188+0000","last_undegraded":"2024-09-13T18:16:09.036188+0000","last_fullsized":"2024-09-13T18:16:09.036188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:49.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.039126+0000","last_change":"2024-09-13T18:15:06.027697+0000","last_active":"2024-09-13T18:16:09.039126+0000","last_peered":"2024-09-13T18:16:09.039126+0000","last_clean":"2024-09-13T18:16:09.039126+0000","last_became_active":"2024-09-13T18:15:06.027402+0000","last_became_peered":"2024-09-13T18:15:06.027402+0000","last_unstale":"2024-09-13T18:16:09.039126+0000","last_undegraded":"2024-09-13T18:16:09.039126+0000","last_fullsized":"2024-09-13T18:16:09.039126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:45.004828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.034749+0000","last_change":"2024-09-13T18:15:05.562459+0000","last_active":"2024-09-13T18:16:09.034749+0000","last_peered":"2024-09-13T18:16:09.034749+0000","last_clean":"2024-09-13T18:16:09.034749+0000","last_became_active":"2024-09-13T18:15:05.562107+0000","last_became_peered":"2024-09-13T18:15:05.562107+0000","last_unstale":"2024-09-13T18:16:09.034749+0000","last_undegraded":"2024-09-13T18:16:09.034749+0000","last_fullsized":"2024-09-13T18:16:09.034749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:39.740829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.035583+0000","last_change":"2024-09-13T18:15:06.027566+0000","last_active":"2024-09-13T18:16:09.035583+0000","last_peered":"2024-09-13T18:16:09.035583+0000","last_clean":"2024-09-13T18:16:09.035583+0000","last_became_active":"2024-09-13T18:15:06.027271+0000","last_became_peered":"2024-09-13T18:15:06.027271+0000","last_unstale":"2024-09-13T18:16:09.035583+0000","last_undegraded":"2024-09-13T18:16:09.035583+0000","last_fullsized":"2024-09-13T18:16:09.035583+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:37.929848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:10.054601+0000","last_change":"2024-09-13T18:16:10.054180+0000","last_active":"2024-09-13T18:16:10.054601+0000","last_peered":"2024-09-13T18:16:10.054601+0000","last_clean":"2024-09-13T18:16:10.054601+0000","last_became_active":"2024-09-13T18:16:10.044444+0000","last_became_peered":"2024-09-13T18:16:10.044444+0000","last_unstale":"2024-09-13T18:16:10.054601+0000","last_undegraded":"2024-09-13T18:16:10.054601+0000","last_fullsized":"2024-09-13T18:16:10.054601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:11.967345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.032420+0000","last_change":"2024-09-13T18:15:06.041388+0000","last_active":"2024-09-13T18:16:09.032420+0000","last_peered":"2024-09-13T18:16:09.032420+0000","last_clean":"2024-09-13T18:16:09.032420+0000","last_became_active":"2024-09-13T18:15:06.041102+0000","last_became_peered":"2024-09-13T18:15:06.041102+0000","last_unstale":"2024-09-13T18:16:09.032420+0000","last_undegraded":"2024-09-13T18:16:09.032420+0000","last_fullsized":"2024-09-13T18:16:09.032420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:13.919598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037427+0000","last_change":"2024-09-13T18:15:05.573970+0000","last_active":"2024-09-13T18:16:09.037427+0000","last_peered":"2024-09-13T18:16:09.037427+0000","last_clean":"2024-09-13T18:16:09.037427+0000","last_became_active":"2024-09-13T18:15:05.571778+0000","last_became_peered":"2024-09-13T18:15:05.571778+0000","last_unstale":"2024-09-13T18:16:09.037427+0000","last_undegraded":"2024-09-13T18:16:09.037427+0000","last_fullsized":"2024-09-13T18:16:09.037427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:52.799646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:16:09.037508+0000","last_change":"2024-09-13T18:15:06.025563+0000","last_active":"2024-09-13T18:16:09.037508+0000","last_peered":"2024-09-13T18:16:09.037508+0000","last_clean":"2024-09-13T18:16:09.037508+0000","last_became_active":"2024-09-13T18:15:06.025257+0000","last_became_peered":"2024-09-13T18:15:06.025257+0000","last_unstale":"2024-09-13T18:16:09.037508+0000","last_undegraded":"2024-09-13T18:16:09.037508+0000","last_fullsized":"2024-09-13T18:16:09.037508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:05.542345+0000","last_clean_scrub_stamp":"2024-09-13T18:15:05.542345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:52.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":104,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:16:26.820173+0000","last_change":"2024-09-13T18:15:05.562126+0000","last_active":"2024-09-13T18:16:26.820173+0000","last_peered":"2024-09-13T18:16:26.820173+0000","last_clean":"2024-09-13T18:16:26.820173+0000","last_became_active":"2024-09-13T18:15:05.561646+0000","last_became_peered":"2024-09-13T18:15:05.561646+0000","last_unstale":"2024-09-13T18:16:26.820173+0000","last_undegraded":"2024-09-13T18:16:26.820173+0000","last_fullsized":"2024-09-13T18:16:26.820173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:15:04.535946+0000","last_clean_scrub_stamp":"2024-09-13T18:15:04.535946+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68013,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":785,"num_read_kb":467,"num_write":232,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351006,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":958464,"data_stored":459614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78900000000000003,"5min":1.006,"15min":1.006},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70499999999999996,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70399999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.42499999999999999},"min":{"1min":0.30099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.621,"15min":0.621},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":1.115,"15min":1.115},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51800000000000002,"15min":0.51400000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.79000000000000004,"5min":1.464,"15min":1.464},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.49399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.874,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.53500000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80600000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.65900000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.49099999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.61899999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93100000000000005,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.47699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90700000000000003,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.629}]},{"osd":10,"last update":"Fri Sep 13 18:16:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.57899999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.84099999999999997,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.60099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68799999999999994}]}]},{"osd":10,"up_from":73,"seq":313532612641,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1658880,"data_stored":1112034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.501},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.434,"15min":0.438},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.36899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.623},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76900000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.63200000000000001,"15min":0.64700000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.436},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53200000000000003,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75800000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.44900000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.871,"15min":0.871},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:14:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53400000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71299999999999997,"15min":0.71799999999999997},"min":{"1min":0.51300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82199999999999995,"5min":1.01,"15min":1.01},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.056,"15min":1.056},"last":0.72699999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.0549999999999997,"5min":4.0549999999999997,"15min":4.0549999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.80000000000000004}]},{"osd":11,"last update":"Fri Sep 13 18:16:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92200000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.83299999999999996}]}]},{"osd":9,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":459592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.33900000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.95199999999999996,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.34899999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.75,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.48999999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91800000000000004,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.446,"5min":0.86699999999999999,"15min":0.77100000000000002},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":18.207999999999998,"5min":18.207999999999998,"15min":18.207999999999998},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90800000000000003,"5min":0.999,"15min":0.999},"last":0.503},{"interface":"front","average":{"1min":0.621,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96899999999999997,"5min":1.125,"15min":1.125},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.755,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88100000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.48799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.85799999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0349999999999999,"5min":2.202,"15min":2.202},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0129999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.91900000000000004,"15min":0.94799999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.099,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.873,"15min":0.90000000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.85599999999999998,"15min":0.87},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0409999999999999,"5min":1.306,"15min":1.306},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98399999999999999,"5min":1.262,"15min":1.262},"last":0.74199999999999999}]},{"osd":8,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":1.036,"15min":0.94699999999999995},"min":{"1min":0.64000000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":18.175999999999998,"5min":18.175999999999998,"15min":18.175999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.96999999999999997,"15min":0.996},"min":{"1min":0.69099999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":2.423,"15min":2.423},"last":0.84099999999999997}]},{"osd":10,"last update":"Fri Sep 13 18:15:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88100000000000001,"15min":0.89100000000000001},"min":{"1min":0.67700000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.0309999999999999,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0169999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.86199999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037805,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":459970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.752,"5min":0.87,"15min":0.87},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36299999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55800000000000005,"15min":0.55500000000000005},"min":{"1min":0.42099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38300000000000001,"15min":0.39400000000000002},"min":{"1min":0.23799999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48099999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.41299999999999998,"15min":0.42699999999999999},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.47199999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.71199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.41699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73899999999999999,"5min":0.747,"15min":0.747},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.495},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.48399999999999999},"min":{"1min":0.32400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.52300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.62},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.61799999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:15:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58299999999999996}]},{"osd":10,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.64400000000000002},"min":{"1min":0.53400000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.73399999999999999}]},{"osd":11,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66700000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299440,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1576960,"data_stored":1052737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:46 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73399999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.443}]},{"osd":1,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.35799999999999998,"15min":0.35099999999999998},"min":{"1min":0.28499999999999998,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70699999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53500000000000003,"15min":0.52000000000000002},"min":{"1min":0.46700000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77800000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.76900000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.69999999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.44,"15min":0.42999999999999999},"min":{"1min":0.35799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66300000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.78900000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63200000000000001,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.72899999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.53200000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.83699999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.42699999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56200000000000006}]},{"osd":9,"last update":"Fri Sep 13 18:15:31 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.44,"5min":0.438,"15min":0.438},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.747,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.4199999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":0.75}]},{"osd":10,"last update":"Fri Sep 13 18:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67000000000000004,"15min":0.67800000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52200000000000002}]},{"osd":11,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.76900000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462965,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":966656,"data_stored":459261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.746,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.629,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.871,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93600000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0309999999999999,"5min":1.044,"15min":1.044},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.24,"5min":0.81200000000000006,"15min":0.73599999999999999},"min":{"1min":0.433,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":11.686,"5min":11.686,"15min":11.686},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.627},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95799999999999996,"5min":1.397,"15min":1.397},"last":0.438},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65400000000000003,"15min":0.63900000000000001},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93400000000000005,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.165,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.505,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97299999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.48499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.018,"5min":1.22,"15min":1.22},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.79100000000000004,"15min":0.77000000000000002},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1000000000000001,"5min":1.486,"15min":1.486},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:15:45 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79900000000000004,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.997,"5min":1.212,"15min":1.212},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.56899999999999995,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.53300000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:16:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.91700000000000004,"15min":0.83199999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93000000000000005,"5min":11.670999999999999,"15min":11.670999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.88300000000000001,"15min":0.873},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.71499999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:15:31 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":0.95599999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.89500000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1379999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.64400000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:15:58 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.89400000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1220000000000001,"5min":1.286,"15min":1.286},"last":0.629},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.97499999999999998,"15min":0.996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.1659999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.69099999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724604,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32668,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712484,"statfs":{"total":95995035648,"available":95961583616,"internally_reserved":0,"allocated":1585152,"data_stored":1051838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61699999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.753},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":1.175,"15min":1.175},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52600000000000002,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77800000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.496},"min":{"1min":0.374,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72499999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627}]},{"osd":2,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.252,"5min":0.251,"15min":0.251},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.432},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.39200000000000002},"min":{"1min":0.24199999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.60699999999999998,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69399999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86099999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:16:27 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.621},"min":{"1min":0.48799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82799999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60299999999999998,"15min":0.59199999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77600000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54800000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:15:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.47599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57599999999999996}]},{"osd":8,"last update":"Fri Sep 13 18:16:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.502,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.76500000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58599999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:15:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.70399999999999996}]},{"osd":10,"last update":"Fri Sep 13 18:15:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.72799999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888127,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":974848,"data_stored":459626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.48999999999999999},"min":{"1min":0.39000000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.372},"min":{"1min":0.29299999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39300000000000002,"15min":0.39500000000000002},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81699999999999995,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:15:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72599999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:15:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82399999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.58999999999999997,"15min":0.55800000000000005},"min":{"1min":0.45800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:16:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73799999999999999,"5min":0.873,"15min":0.873},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67700000000000005,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78700000000000003,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:15:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.51300000000000001,"15min":0.48699999999999999},"min":{"1min":0.379,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.39400000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.89700000000000002,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.875,"5min":18.643000000000001,"15min":18.643000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.93500000000000005,"15min":0.72199999999999998},"min":{"1min":0.60799999999999998,"5min":0.502,"15min":0.502},"max":{"1min":0.95799999999999996,"5min":18.629999999999999,"15min":18.629999999999999},"last":0.57699999999999996}]},{"osd":9,"last update":"Fri Sep 13 18:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.57699999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91400000000000003,"5min":1.123,"15min":1.123},"last":0.754},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.58799999999999997}]},{"osd":10,"last update":"Fri Sep 13 18:15:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.51900000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.83599999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71799999999999997,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97199999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.71999999999999997}]},{"osd":11,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68600000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":978944,"data_stored":458803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.371},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.46000000000000002},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.59699999999999998,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.63800000000000001,"15min":0.59799999999999998},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.64200000000000002,"15min":0.61899999999999999},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68000000000000005,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.71599999999999997,"15min":0.64000000000000001},"min":{"1min":0.50700000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.68700000000000006,"15min":0.63700000000000001},"min":{"1min":0.51300000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.93899999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:16:01 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.69299999999999995,"15min":0.66500000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.72999999999999998,"15min":0.68899999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76300000000000001,"15min":0.69899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:15:42 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81599999999999995,"15min":0.78400000000000003},"min":{"1min":0.57599999999999996,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.745,"15min":0.72399999999999998},"min":{"1min":0.54300000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.97599999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.88},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":1.1499999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95199999999999996,"15min":0.94299999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.052}]},{"osd":10,"last update":"Fri Sep 13 18:15:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79200000000000004,"15min":0.78700000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.96699999999999997,"15min":0.95899999999999996},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.92400000000000004}]},{"osd":11,"last update":"Fri Sep 13 18:16:05 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.0129999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":521625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.56499999999999995,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:15:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52700000000000002},"min":{"1min":0.41999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.748,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.74199999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:15:51 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.41999999999999998,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.62},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.42199999999999999},"min":{"1min":0.34200000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.67100000000000004,"15min":0.60999999999999999},"min":{"1min":0.42399999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.746},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.66100000000000003,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.436,"15min":0.436},"max":{"1min":6.4509999999999996,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:14:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68300000000000005}]},{"osd":8,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68200000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71799999999999997,"5min":1.135,"15min":1.135},"last":0.72199999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:15:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71599999999999997,"15min":0.70299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.0179999999999998,"5min":3.0179999999999998,"15min":3.0179999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70999999999999996}]},{"osd":10,"last update":"Fri Sep 13 18:15:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.52600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68799999999999994,"15min":0.68999999999999995},"min":{"1min":0.48299999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82699999999999996,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.65100000000000002}]},{"osd":11,"last update":"Fri Sep 13 18:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.75800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":521173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:16:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56599999999999995,"15min":0.52400000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.74099999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.54400000000000004},"min":{"1min":0.41499999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:15:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.38200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53600000000000003,"15min":0.51300000000000001},"min":{"1min":0.47199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 18:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59099999999999997,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.64100000000000001,"15min":0.59299999999999997},"min":{"1min":0.33300000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.7389999999999999,"5min":4.7389999999999999,"15min":4.7389999999999999},"last":0.495}]},{"osd":4,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.39900000000000002},"min":{"1min":0.36399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47799999999999998,"15min":0.44700000000000001},"min":{"1min":0.311,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:15:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.57799999999999996,"15min":0.54700000000000004},"min":{"1min":0.51500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.59899999999999998,"15min":0.55500000000000005},"min":{"1min":0.53700000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.66100000000000003,"15min":0.61699999999999999},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93999999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.746},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:15:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.54700000000000004,"15min":0.52000000000000002},"min":{"1min":0.41199999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.35699999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.84399999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.36399999999999999}]},{"osd":8,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.57299999999999995},"min":{"1min":0.47799999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.68400000000000005,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58599999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:15:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.56999999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.59399999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.94899999999999995,"5min":1.002,"15min":1.002},"last":0.64000000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92400000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.55100000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.47699999999999998}]},{"osd":11,"last update":"Fri Sep 13 18:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67200000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":460600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.53700000000000003},"min":{"1min":0.44600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.88200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:15:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.629,"15min":0.58299999999999996},"min":{"1min":0.50800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60499999999999998,"15min":0.55300000000000005},"min":{"1min":0.45400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89300000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.629,"15min":0.60099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95299999999999996,"5min":1.069,"15min":1.069},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:15:58 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70999999999999996,"15min":0.69699999999999995},"min":{"1min":0.53100000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:15:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.61399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.046,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 18:14:41 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.755,"15min":0.751},"min":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.69699999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81999999999999995,"15min":0.84299999999999997},"min":{"1min":0.57599999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.82099999999999995,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79800000000000004}]},{"osd":9,"last update":"Fri Sep 13 18:15:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.92300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.139,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79200000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:15:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.876,"15min":0.88},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88400000000000001,"15min":0.88700000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1859999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.95099999999999996}]},{"osd":11,"last update":"Fri Sep 13 18:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.871}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:16:32.138 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T18:16:32.138 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:16:32.138 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:16:32.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T18:16:32.457 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:32.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:32 smithi007 ceph-mon[30588]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:16:32.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:32 smithi116 ceph-mon[35109]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:16:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:32 smithi067 ceph-mon[35103]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:16:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 -- 172.21.15.7:0/3871103925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c102bb0 msgr2=0x7f1a5c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 --2- 172.21.15.7:0/3871103925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c102bb0 0x7f1a5c106c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009930 tx=0x7f1a4802a440 comp rx=0 tx=0).stop 2024-09-13T18:16:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 -- 172.21.15.7:0/3871103925 shutdown_connections 2024-09-13T18:16:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 --2- 172.21.15.7:0/3871103925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c107330 0x7f1a5c10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 --2- 172.21.15.7:0/3871103925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c102bb0 0x7f1a5c106c00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 --2- 172.21.15.7:0/3871103925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a5c102200 0x7f1a5c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 -- 172.21.15.7:0/3871103925 >> 172.21.15.7:0/3871103925 conn(0x7f1a5c0fdc60 msgr2=0x7f1a5c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 -- 172.21.15.7:0/3871103925 shutdown_connections 2024-09-13T18:16:34.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.344+0000 7f1a62c00640 1 -- 172.21.15.7:0/3871103925 wait complete. 2024-09-13T18:16:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.345+0000 7f1a62c00640 1 Processor -- start 2024-09-13T18:16:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a62c00640 1 -- start start 2024-09-13T18:16:34.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a62c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c102200 0x7f1a5c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a62c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a5c102bb0 0x7f1a5c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a62c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c107330 0x7f1a5c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a62c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c19d400 con 0x7f1a5c107330 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a62c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c19d570 con 0x7f1a5c102200 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a62c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c19d6e0 con 0x7f1a5c102bb0 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a5be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c102200 0x7f1a5c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a5be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c102200 0x7f1a5c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55320/0 (socket says 172.21.15.7:55320) 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a60c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c107330 0x7f1a5c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a5be00640 1 -- 172.21.15.7:0/929471470 learned_addr learned my addr 172.21.15.7:0/929471470 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.346+0000 7f1a5b400640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a5c102bb0 0x7f1a5c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a5be00640 1 -- 172.21.15.7:0/929471470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a5c102bb0 msgr2=0x7f1a5c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a5be00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a5c102bb0 0x7f1a5c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a5be00640 1 -- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c107330 msgr2=0x7f1a5c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a5be00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c107330 0x7f1a5c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a5be00640 1 -- 172.21.15.7:0/929471470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48009560 con 0x7f1a5c102200 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a60c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c107330 0x7f1a5c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a5be00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c102200 0x7f1a5c198510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00e9f0 tx=0x7f1a4c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a58c00640 1 -- 172.21.15.7:0/929471470 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c009720 con 0x7f1a5c102200 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a58c00640 1 -- 172.21.15.7:0/929471470 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a4c00cd80 con 0x7f1a5c102200 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c19d9c0 con 0x7f1a5c102200 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a58c00640 1 -- 172.21.15.7:0/929471470 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c010430 con 0x7f1a5c102200 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.347+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c19dc70 con 0x7f1a5c102200 2024-09-13T18:16:34.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.348+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c1036e0 con 0x7f1a5c102200 2024-09-13T18:16:34.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.350+0000 7f1a58c00640 1 -- 172.21.15.7:0/929471470 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f1a4c005000 con 0x7f1a5c102200 2024-09-13T18:16:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.352+0000 7f1a58c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a400a1110 0x7f1a400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.352+0000 7f1a58c00640 1 -- 172.21.15.7:0/929471470 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1a4c014070 con 0x7f1a5c102200 2024-09-13T18:16:34.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.352+0000 7f1a5b400640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a400a1110 0x7f1a400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:34.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.353+0000 7f1a5b400640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a400a1110 0x7f1a400a35d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a48005940 tx=0x7f1a480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:34.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.354+0000 7f1a58c00640 1 -- 172.21.15.7:0/929471470 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1a4c0964f0 con 0x7f1a5c102200 2024-09-13T18:16:34.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.569+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1a5c10a570 con 0x7f1a5c102200 2024-09-13T18:16:34.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.569+0000 7f1a58c00640 1 -- 172.21.15.7:0/929471470 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1a4c099b10 con 0x7f1a5c102200 2024-09-13T18:16:34.572 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:34.572 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:16:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a400a1110 msgr2=0x7f1a400a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a400a1110 0x7f1a400a35d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a48005940 tx=0x7f1a480058d0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c102200 msgr2=0x7f1a5c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c102200 0x7f1a5c198510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00e9f0 tx=0x7f1a4c00edf0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 shutdown_connections 2024-09-13T18:16:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a400a1110 0x7f1a400a35d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c107330 0x7f1a5c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a5c102bb0 0x7f1a5c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 --2- 172.21.15.7:0/929471470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a5c102200 0x7f1a5c198510 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 >> 172.21.15.7:0/929471470 conn(0x7f1a5c0fdc60 msgr2=0x7f1a5c0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 shutdown_connections 2024-09-13T18:16:34.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:34.572+0000 7f1a62c00640 1 -- 172.21.15.7:0/929471470 wait complete. 2024-09-13T18:16:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:34 smithi116 ceph-mon[35109]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:34 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/929471470' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:16:34.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:34 smithi007 ceph-mon[30588]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:34.986 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:34 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/929471470' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:16:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:34 smithi067 ceph-mon[35103]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:34 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/929471470' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:16:35.329 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:16:35.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 -- 172.21.15.7:0/2819124163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b441031d0 msgr2=0x7f1b44103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2819124163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b441031d0 0x7f1b44103650 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009900 tx=0x7f1b3002a410 comp rx=0 tx=0).stop 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 -- 172.21.15.7:0/2819124163 shutdown_connections 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2819124163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b44103b90 0x7f1b4410a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2819124163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b441031d0 0x7f1b44103650 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2819124163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44101fe0 0x7f1b441023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 -- 172.21.15.7:0/2819124163 >> 172.21.15.7:0/2819124163 conn(0x7f1b440fd760 msgr2=0x7f1b440ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 -- 172.21.15.7:0/2819124163 shutdown_connections 2024-09-13T18:16:35.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.487+0000 7f1b4b000640 1 -- 172.21.15.7:0/2819124163 wait complete. 2024-09-13T18:16:35.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.488+0000 7f1b4b000640 1 Processor -- start 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.488+0000 7f1b4b000640 1 -- start start 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b4b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44101fe0 0x7f1b44197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b4b000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b441031d0 0x7f1b44198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b4b000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b44103b90 0x7f1b4419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b4b000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4419fac0 con 0x7f1b44103b90 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b4b000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4419fc30 con 0x7f1b44101fe0 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b4b000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4419fdf0 con 0x7f1b441031d0 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b44103b90 0x7f1b4419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b44103b90 0x7f1b4419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57218/0 (socket says 172.21.15.7:57218) 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 -- 172.21.15.7:0/2969893080 learned_addr learned my addr 172.21.15.7:0/2969893080 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b43e00640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44101fe0 0x7f1b44197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b43400640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b441031d0 0x7f1b44198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 -- 172.21.15.7:0/2969893080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b441031d0 msgr2=0x7f1b44198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b441031d0 0x7f1b44198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 -- 172.21.15.7:0/2969893080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44101fe0 msgr2=0x7f1b44197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44101fe0 0x7f1b44197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b49000640 1 -- 172.21.15.7:0/2969893080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009560 con 0x7f1b44103b90 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b43e00640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44101fe0 0x7f1b44197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.489+0000 7f1b43400640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b441031d0 0x7f1b44198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.490+0000 7f1b49000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b44103b90 0x7f1b4419f580 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00eb10 tx=0x7f1b3c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.490+0000 7f1b40c00640 1 -- 172.21.15.7:0/2969893080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c004b20 con 0x7f1b44103b90 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.490+0000 7f1b40c00640 1 -- 172.21.15.7:0/2969893080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b3c004c80 con 0x7f1b44103b90 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.490+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b441a00d0 con 0x7f1b44103b90 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.490+0000 7f1b40c00640 1 -- 172.21.15.7:0/2969893080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c010690 con 0x7f1b44103b90 2024-09-13T18:16:35.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.490+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b441a05b0 con 0x7f1b44103b90 2024-09-13T18:16:35.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.491+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b44109490 con 0x7f1b44103b90 2024-09-13T18:16:35.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.493+0000 7f1b40c00640 1 -- 172.21.15.7:0/2969893080 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f1b3c005020 con 0x7f1b44103b90 2024-09-13T18:16:35.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.494+0000 7f1b40c00640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b280a11a0 0x7f1b280a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.494+0000 7f1b40c00640 1 -- 172.21.15.7:0/2969893080 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1b3c014070 con 0x7f1b44103b90 2024-09-13T18:16:35.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.495+0000 7f1b43e00640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b280a11a0 0x7f1b280a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.495+0000 7f1b43e00640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b280a11a0 0x7f1b280a3660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1b44103030 tx=0x7f1b34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:35.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.498+0000 7f1b40c00640 1 -- 172.21.15.7:0/2969893080 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1b3c096670 con 0x7f1b44103b90 2024-09-13T18:16:35.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.681+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b4410d8f0 con 0x7f1b44103b90 2024-09-13T18:16:35.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.682+0000 7f1b40c00640 1 -- 172.21.15.7:0/2969893080 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7f1b3c099c90 con 0x7f1b44103b90 2024-09-13T18:16:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:35.685 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:16:35.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b280a11a0 msgr2=0x7f1b280a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b280a11a0 0x7f1b280a3660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1b44103030 tx=0x7f1b34005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b44103b90 msgr2=0x7f1b4419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b44103b90 0x7f1b4419f580 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00eb10 tx=0x7f1b3c00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 shutdown_connections 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b280a11a0 0x7f1b280a3660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b44103b90 0x7f1b4419f580 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b441031d0 0x7f1b44198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 --2- 172.21.15.7:0/2969893080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b44101fe0 0x7f1b44197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 >> 172.21.15.7:0/2969893080 conn(0x7f1b440fd760 msgr2=0x7f1b44106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.684+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 shutdown_connections 2024-09-13T18:16:35.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.685+0000 7f1b4b000640 1 -- 172.21.15.7:0/2969893080 wait complete. 2024-09-13T18:16:35.703 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:15:04.217247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:15:05.500183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:16:35.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:16:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.860+0000 7f94f9000640 1 -- 172.21.15.7:0/556592814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f4074e70 msgr2=0x7f94f4075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.860+0000 7f94f9000640 1 --2- 172.21.15.7:0/556592814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f4074e70 0x7f94f4075270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009ca0 tx=0x7f94e402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.861+0000 7f94f9000640 1 -- 172.21.15.7:0/556592814 shutdown_connections 2024-09-13T18:16:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.861+0000 7f94f9000640 1 --2- 172.21.15.7:0/556592814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f4076a50 0x7f94f40772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.861+0000 7f94f9000640 1 --2- 172.21.15.7:0/556592814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94f40760b0 0x7f94f4076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.861+0000 7f94f9000640 1 --2- 172.21.15.7:0/556592814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f4074e70 0x7f94f4075270 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.861+0000 7f94f9000640 1 -- 172.21.15.7:0/556592814 >> 172.21.15.7:0/556592814 conn(0x7f94f40fd460 msgr2=0x7f94f40ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.861+0000 7f94f9000640 1 -- 172.21.15.7:0/556592814 shutdown_connections 2024-09-13T18:16:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.861+0000 7f94f9000640 1 -- 172.21.15.7:0/556592814 wait complete. 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 Processor -- start 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 -- start start 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f4074e70 0x7f94f419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f40760b0 0x7f94f419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94f4076a50 0x7f94f41a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41a3ba0 con 0x7f94f40760b0 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41a3d10 con 0x7f94f4074e70 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f9000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41a3ed0 con 0x7f94f4076a50 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f40760b0 0x7f94f419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94eaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f40760b0 0x7f94f419c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57242/0 (socket says 172.21.15.7:57242) 2024-09-13T18:16:35.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94eaa00640 1 -- 172.21.15.7:0/3641382038 learned_addr learned my addr 172.21.15.7:0/3641382038 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f3400640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f4074e70 0x7f94f419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.862+0000 7f94f3e00640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94f4076a50 0x7f94f41a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94eaa00640 1 -- 172.21.15.7:0/3641382038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94f4076a50 msgr2=0x7f94f41a3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94eaa00640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94f4076a50 0x7f94f41a3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94eaa00640 1 -- 172.21.15.7:0/3641382038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f4074e70 msgr2=0x7f94f419c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94eaa00640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f4074e70 0x7f94f419c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94eaa00640 1 -- 172.21.15.7:0/3641382038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4009900 con 0x7f94f40760b0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94f3400640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f4074e70 0x7f94f419c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94eaa00640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f40760b0 0x7f94f419c5f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00d950 tx=0x7f94dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94f0c00640 1 -- 172.21.15.7:0/3641382038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc009c30 con 0x7f94f40760b0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94f0c00640 1 -- 172.21.15.7:0/3641382038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94dc009d90 con 0x7f94f40760b0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94f0c00640 1 -- 172.21.15.7:0/3641382038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00f740 con 0x7f94f40760b0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f41a41b0 con 0x7f94f40760b0 2024-09-13T18:16:35.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.863+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f41a46c0 con 0x7f94f40760b0 2024-09-13T18:16:35.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.864+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f410e650 con 0x7f94f40760b0 2024-09-13T18:16:35.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.867+0000 7f94f0c00640 1 -- 172.21.15.7:0/3641382038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f94dc010a20 con 0x7f94f40760b0 2024-09-13T18:16:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.868+0000 7f94f0c00640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f94d80a11a0 0x7f94d80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.868+0000 7f94f0c00640 1 -- 172.21.15.7:0/3641382038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f94dc0cc600 con 0x7f94f40760b0 2024-09-13T18:16:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.869+0000 7f94f3400640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f94d80a11a0 0x7f94d80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:35.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.869+0000 7f94f3400640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f94d80a11a0 0x7f94d80a3660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94e402aeb0 tx=0x7f94e4031c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:35.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:35.872+0000 7f94f0c00640 1 -- 172.21.15.7:0/3641382038 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f94dc095c90 con 0x7f94f40760b0 2024-09-13T18:16:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:35 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2969893080' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:36.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:35 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2969893080' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:36.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.053+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94f4111bb0 con 0x7f94f40760b0 2024-09-13T18:16:36.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.054+0000 7f94f0c00640 1 -- 172.21.15.7:0/3641382038 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94dc0992b0 con 0x7f94f40760b0 2024-09-13T18:16:36.056 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:16:36.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f94d80a11a0 msgr2=0x7f94d80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f94d80a11a0 0x7f94d80a3660 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94e402aeb0 tx=0x7f94e4031c00 comp rx=0 tx=0).stop 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f40760b0 msgr2=0x7f94f419c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f40760b0 0x7f94f419c5f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00d950 tx=0x7f94dc00de10 comp rx=0 tx=0).stop 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 shutdown_connections 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f94d80a11a0 0x7f94d80a3660 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94f4076a50 0x7f94f41a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94f40760b0 0x7f94f419c5f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 --2- 172.21.15.7:0/3641382038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f4074e70 0x7f94f419c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 >> 172.21.15.7:0/3641382038 conn(0x7f94f40fd460 msgr2=0x7f94f40fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 shutdown_connections 2024-09-13T18:16:36.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.056+0000 7f94f9000640 1 -- 172.21.15.7:0/3641382038 wait complete. 2024-09-13T18:16:36.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:16:36.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:35 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2969893080' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.232+0000 7f04d3a00640 1 -- 172.21.15.7:0/1244954947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc0ffd90 msgr2=0x7f04cc100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.232+0000 7f04d3a00640 1 --2- 172.21.15.7:0/1244954947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc0ffd90 0x7f04cc100190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009860 tx=0x7f04bc02a340 comp rx=0 tx=0).stop 2024-09-13T18:16:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.233+0000 7f04d3a00640 1 -- 172.21.15.7:0/1244954947 shutdown_connections 2024-09-13T18:16:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.233+0000 7f04d3a00640 1 --2- 172.21.15.7:0/1244954947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc101940 0x7f04cc1081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.233+0000 7f04d3a00640 1 --2- 172.21.15.7:0/1244954947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04cc100f80 0x7f04cc101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.233+0000 7f04d3a00640 1 --2- 172.21.15.7:0/1244954947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc0ffd90 0x7f04cc100190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.233+0000 7f04d3a00640 1 -- 172.21.15.7:0/1244954947 >> 172.21.15.7:0/1244954947 conn(0x7f04cc0fb510 msgr2=0x7f04cc0fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:36.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.233+0000 7f04d3a00640 1 -- 172.21.15.7:0/1244954947 shutdown_connections 2024-09-13T18:16:36.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.233+0000 7f04d3a00640 1 -- 172.21.15.7:0/1244954947 wait complete. 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 Processor -- start 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 -- start start 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc0ffd90 0x7f04cc197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04cc100f80 0x7f04cc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc101940 0x7f04cc19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc19fab0 con 0x7f04cc0ffd90 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc19fc20 con 0x7f04cc101940 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d3a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc19fde0 con 0x7f04cc100f80 2024-09-13T18:16:36.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc0ffd90 0x7f04cc197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc0ffd90 0x7f04cc197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57258/0 (socket says 172.21.15.7:57258) 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04d1000640 1 -- 172.21.15.7:0/3391777664 learned_addr learned my addr 172.21.15.7:0/3391777664 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.234+0000 7f04c3e00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04cc100f80 0x7f04cc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d1a00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc101940 0x7f04cc19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d1000640 1 -- 172.21.15.7:0/3391777664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04cc100f80 msgr2=0x7f04cc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d1000640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04cc100f80 0x7f04cc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d1000640 1 -- 172.21.15.7:0/3391777664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc101940 msgr2=0x7f04cc19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d1000640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc101940 0x7f04cc19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d1000640 1 -- 172.21.15.7:0/3391777664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc009490 con 0x7f04cc0ffd90 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d1000640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc0ffd90 0x7f04cc197fc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0304b0 tx=0x7f04bc032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04ca000640 1 -- 172.21.15.7:0/3391777664 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc032770 con 0x7f04cc0ffd90 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04ca000640 1 -- 172.21.15.7:0/3391777664 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04bc004500 con 0x7f04cc0ffd90 2024-09-13T18:16:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04ca000640 1 -- 172.21.15.7:0/3391777664 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc004920 con 0x7f04cc0ffd90 2024-09-13T18:16:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.235+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc1a0060 con 0x7f04cc0ffd90 2024-09-13T18:16:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.236+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc1a04c0 con 0x7f04cc0ffd90 2024-09-13T18:16:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.237+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc10b650 con 0x7f04cc0ffd90 2024-09-13T18:16:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.238+0000 7f04ca000640 1 -- 172.21.15.7:0/3391777664 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f04bc005050 con 0x7f04cc0ffd90 2024-09-13T18:16:36.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.240+0000 7f04ca000640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04b00a1120 0x7f04b00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.241+0000 7f04ca000640 1 -- 172.21.15.7:0/3391777664 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f04bc0ed0f0 con 0x7f04cc0ffd90 2024-09-13T18:16:36.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.241+0000 7f04c3e00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04b00a1120 0x7f04b00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.241+0000 7f04c3e00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04b00a1120 0x7f04b00a35e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1994d0 tx=0x7f04b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:36.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.245+0000 7f04ca000640 1 -- 172.21.15.7:0/3391777664 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f04bc0b6840 con 0x7f04cc0ffd90 2024-09-13T18:16:36.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.427+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04cc1a08d0 con 0x7f04cc0ffd90 2024-09-13T18:16:36.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.428+0000 7f04ca000640 1 -- 172.21.15.7:0/3391777664 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04bc0b9e60 con 0x7f04cc0ffd90 2024-09-13T18:16:36.431 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04b00a1120 msgr2=0x7f04b00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04b00a1120 0x7f04b00a35e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1994d0 tx=0x7f04b4009260 comp rx=0 tx=0).stop 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc0ffd90 msgr2=0x7f04cc197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc0ffd90 0x7f04cc197fc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0304b0 tx=0x7f04bc032d20 comp rx=0 tx=0).stop 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 shutdown_connections 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f04b00a1120 0x7f04b00a35e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04cc101940 0x7f04cc19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04cc100f80 0x7f04cc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 --2- 172.21.15.7:0/3391777664 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04cc0ffd90 0x7f04cc197fc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 >> 172.21.15.7:0/3391777664 conn(0x7f04cc0fb510 msgr2=0x7f04cc1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 shutdown_connections 2024-09-13T18:16:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.430+0000 7f04d3a00640 1 -- 172.21.15.7:0/3391777664 wait complete. 2024-09-13T18:16:36.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:16:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 -- 172.21.15.7:0/1697654356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c0101940 msgr2=0x7f82c01081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 --2- 172.21.15.7:0/1697654356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c0101940 0x7f82c01081d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009be0 tx=0x7f82b802a6c0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 -- 172.21.15.7:0/1697654356 shutdown_connections 2024-09-13T18:16:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 --2- 172.21.15.7:0/1697654356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c0101940 0x7f82c01081d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 --2- 172.21.15.7:0/1697654356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c0100f80 0x7f82c0101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 --2- 172.21.15.7:0/1697654356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c00ffd90 0x7f82c0100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 -- 172.21.15.7:0/1697654356 >> 172.21.15.7:0/1697654356 conn(0x7f82c00fb510 msgr2=0x7f82c00fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:36.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.607+0000 7f82c5000640 1 -- 172.21.15.7:0/1697654356 shutdown_connections 2024-09-13T18:16:36.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.608+0000 7f82c5000640 1 -- 172.21.15.7:0/1697654356 wait complete. 2024-09-13T18:16:36.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.608+0000 7f82c5000640 1 Processor -- start 2024-09-13T18:16:36.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82c5000640 1 -- start start 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82c5000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c00ffd90 0x7f82c0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82c5000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c0100f80 0x7f82c00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82c5000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c0101940 0x7f82c0072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82c5000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c0073540 con 0x7f82c00ffd90 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82c5000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00736b0 con 0x7f82c0101940 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82c5000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c019fe20 con 0x7f82c0100f80 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c00ffd90 0x7f82c0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c00ffd90 0x7f82c0074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57270/0 (socket says 172.21.15.7:57270) 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 -- 172.21.15.7:0/1805461969 learned_addr learned my addr 172.21.15.7:0/1805461969 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82be800640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c0101940 0x7f82c0072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bd400640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c0100f80 0x7f82c00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 -- 172.21.15.7:0/1805461969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c0100f80 msgr2=0x7f82c00728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c0100f80 0x7f82c00728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 -- 172.21.15.7:0/1805461969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c0101940 msgr2=0x7f82c0072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c0101940 0x7f82c0072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.609+0000 7f82bde00640 1 -- 172.21.15.7:0/1805461969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0009560 con 0x7f82c00ffd90 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.610+0000 7f82bde00640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c00ffd90 0x7f82c0074260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e9d0 tx=0x7f82b000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.610+0000 7f82b6a00640 1 -- 172.21.15.7:0/1805461969 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b000cde0 con 0x7f82c00ffd90 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.610+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac009490 con 0x7f82c00ffd90 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.610+0000 7f82b6a00640 1 -- 172.21.15.7:0/1805461969 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82b00108f0 con 0x7f82c00ffd90 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.610+0000 7f82b6a00640 1 -- 172.21.15.7:0/1805461969 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b00188e0 con 0x7f82c00ffd90 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.610+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b8009840 con 0x7f82c00ffd90 2024-09-13T18:16:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.611+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c01071f0 con 0x7f82c00ffd90 2024-09-13T18:16:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.613+0000 7f82b6a00640 1 -- 172.21.15.7:0/1805461969 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f82b0010a60 con 0x7f82c00ffd90 2024-09-13T18:16:36.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.614+0000 7f82b6a00640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f82a40a1120 0x7f82a40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.614+0000 7f82b6a00640 1 -- 172.21.15.7:0/1805461969 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f82b0014070 con 0x7f82c00ffd90 2024-09-13T18:16:36.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.614+0000 7f82bd400640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f82a40a1120 0x7f82a40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.615+0000 7f82bd400640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f82a40a1120 0x7f82a40a35e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82c0073fd0 tx=0x7f82ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:36.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.617+0000 7f82b6a00640 1 -- 172.21.15.7:0/1805461969 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f82b00965f0 con 0x7f82c00ffd90 2024-09-13T18:16:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.802+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82c0106c60 con 0x7f82c00ffd90 2024-09-13T18:16:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.802+0000 7f82b6a00640 1 -- 172.21.15.7:0/1805461969 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82b0099c10 con 0x7f82c00ffd90 2024-09-13T18:16:36.805 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T18:16:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f82a40a1120 msgr2=0x7f82a40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f82a40a1120 0x7f82a40a35e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82c0073fd0 tx=0x7f82ac005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c00ffd90 msgr2=0x7f82c0074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c00ffd90 0x7f82c0074260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e9d0 tx=0x7f82b000ee90 comp rx=0 tx=0).stop 2024-09-13T18:16:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 shutdown_connections 2024-09-13T18:16:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f82a40a1120 0x7f82a40a35e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82c0101940 0x7f82c0072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82c0100f80 0x7f82c00728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 --2- 172.21.15.7:0/1805461969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f82c00ffd90 0x7f82c0074260 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 >> 172.21.15.7:0/1805461969 conn(0x7f82c00fb510 msgr2=0x7f82c01043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 shutdown_connections 2024-09-13T18:16:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.805+0000 7f82c5000640 1 -- 172.21.15.7:0/1805461969 wait complete. 2024-09-13T18:16:36.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 -- 172.21.15.7:0/3176542361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc107c50 msgr2=0x7faffc10a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 --2- 172.21.15.7:0/3176542361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc107c50 0x7faffc10a110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faff4009ca0 tx=0x7faff402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 -- 172.21.15.7:0/3176542361 shutdown_connections 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 --2- 172.21.15.7:0/3176542361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc107c50 0x7faffc10a110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 --2- 172.21.15.7:0/3176542361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faffc072f10 0x7faffc073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 --2- 172.21.15.7:0/3176542361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faffc0744f0 0x7faffc072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 -- 172.21.15.7:0/3176542361 >> 172.21.15.7:0/3176542361 conn(0x7faffc0fb540 msgr2=0x7faffc0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 -- 172.21.15.7:0/3176542361 shutdown_connections 2024-09-13T18:16:36.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.981+0000 7fb002000640 1 -- 172.21.15.7:0/3176542361 wait complete. 2024-09-13T18:16:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.982+0000 7fb002000640 1 Processor -- start 2024-09-13T18:16:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.982+0000 7fb002000640 1 -- start start 2024-09-13T18:16:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7fb002000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc072f10 0x7faffc197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7fb002000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faffc0744f0 0x7faffc198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7fb002000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faffc107c50 0x7faffc19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7fb002000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc19fa30 con 0x7faffc072f10 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7fb002000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc19fba0 con 0x7faffc0744f0 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7fb002000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc19fd60 con 0x7faffc107c50 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc072f10 0x7faffc197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffbe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faffc107c50 0x7faffc19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc072f10 0x7faffc197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57300/0 (socket says 172.21.15.7:57300) 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 -- 172.21.15.7:0/2003581478 learned_addr learned my addr 172.21.15.7:0/2003581478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffaa00640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faffc0744f0 0x7faffc198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 -- 172.21.15.7:0/2003581478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faffc107c50 msgr2=0x7faffc19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faffc107c50 0x7faffc19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 -- 172.21.15.7:0/2003581478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faffc0744f0 msgr2=0x7faffc198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:36.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faffc0744f0 0x7faffc198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.983+0000 7faffb400640 1 -- 172.21.15.7:0/2003581478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8009490 con 0x7faffc072f10 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.984+0000 7faffbe00640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faffc107c50 0x7faffc19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.984+0000 7faffb400640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc072f10 0x7faffc197f40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafec00ea60 tx=0x7fafec00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.984+0000 7faff3e00640 1 -- 172.21.15.7:0/2003581478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00cde0 con 0x7faffc072f10 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.984+0000 7faff3e00640 1 -- 172.21.15.7:0/2003581478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafec0035f0 con 0x7faffc072f10 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.984+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec009490 con 0x7faffc072f10 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.984+0000 7faff3e00640 1 -- 172.21.15.7:0/2003581478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0044e0 con 0x7faffc072f10 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.984+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff4009900 con 0x7faffc072f10 2024-09-13T18:16:36.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.985+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc1069d0 con 0x7faffc072f10 2024-09-13T18:16:36.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.987+0000 7faff3e00640 1 -- 172.21.15.7:0/2003581478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fafec003a60 con 0x7faffc072f10 2024-09-13T18:16:36.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.989+0000 7faff3e00640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fafe00a1120 0x7fafe00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:36.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.990+0000 7faff3e00640 1 -- 172.21.15.7:0/2003581478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fafec014070 con 0x7faffc072f10 2024-09-13T18:16:36.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.990+0000 7faffaa00640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fafe00a1120 0x7fafe00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:36.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.990+0000 7faffaa00640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fafe00a1120 0x7fafe00a35e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faffc199450 tx=0x7fafe8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:36.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:36.993+0000 7faff3e00640 1 -- 172.21.15.7:0/2003581478 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fafec096500 con 0x7faffc072f10 2024-09-13T18:16:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:36 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3641382038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:16:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:36 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3391777664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:16:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:36 smithi067 ceph-mon[35103]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:37.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:36 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3641382038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:16:37.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:36 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3391777664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:16:37.022 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:36 smithi007 ceph-mon[30588]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:36 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3641382038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:16:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:36 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3391777664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:16:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:36 smithi116 ceph-mon[35109]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:37.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.211+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faffc10d870 con 0x7faffc072f10 2024-09-13T18:16:37.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.211+0000 7faff3e00640 1 -- 172.21.15.7:0/2003581478 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10889 (secure 0 0 0) 0x7fafec099b20 con 0x7faffc072f10 2024-09-13T18:16:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:37.214 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:15:12.707791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:16:37.214 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.213+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fafe00a1120 msgr2=0x7fafe00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.213+0000 7fb002000640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fafe00a1120 0x7fafe00a35e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faffc199450 tx=0x7fafe8005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.213+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc072f10 msgr2=0x7faffc197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.213+0000 7fb002000640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc072f10 0x7faffc197f40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafec00ea60 tx=0x7fafec00ef20 comp rx=0 tx=0).stop 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 shutdown_connections 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fafe00a1120 0x7fafe00a35e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faffc107c50 0x7faffc19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faffc0744f0 0x7faffc198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 --2- 172.21.15.7:0/2003581478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faffc072f10 0x7faffc197f40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 >> 172.21.15.7:0/2003581478 conn(0x7faffc0fb540 msgr2=0x7faffc103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 shutdown_connections 2024-09-13T18:16:37.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.214+0000 7fb002000640 1 -- 172.21.15.7:0/2003581478 wait complete. 2024-09-13T18:16:37.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 -- 172.21.15.7:0/116233945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0103bb0 msgr2=0x7f46b010a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 --2- 172.21.15.7:0/116233945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0103bb0 0x7f46b010a440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009900 tx=0x7f46a802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 -- 172.21.15.7:0/116233945 shutdown_connections 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 --2- 172.21.15.7:0/116233945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0103bb0 0x7f46b010a440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 --2- 172.21.15.7:0/116233945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b01031f0 0x7f46b0103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 --2- 172.21.15.7:0/116233945 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b0102000 0x7f46b0102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 -- 172.21.15.7:0/116233945 >> 172.21.15.7:0/116233945 conn(0x7f46b00fd760 msgr2=0x7f46b00ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 -- 172.21.15.7:0/116233945 shutdown_connections 2024-09-13T18:16:37.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.388+0000 7f46b6a00640 1 -- 172.21.15.7:0/116233945 wait complete. 2024-09-13T18:16:37.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.389+0000 7f46b6a00640 1 Processor -- start 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.389+0000 7f46b6a00640 1 -- start start 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46b6a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0102000 0x7f46b0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b01031f0 0x7f46b0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46b6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b0103bb0 0x7f46b019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46b6a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b019f9d0 con 0x7f46b01031f0 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46b6a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b019fb40 con 0x7f46b0103bb0 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46b6a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b019fd00 con 0x7f46b0102000 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46a7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b01031f0 0x7f46b0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46a7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b01031f0 0x7f46b0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57308/0 (socket says 172.21.15.7:57308) 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46a7400640 1 -- 172.21.15.7:0/4044249154 learned_addr learned my addr 172.21.15.7:0/4044249154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46b4a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b0103bb0 0x7f46b019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46afe00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0102000 0x7f46b0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46a7400640 1 -- 172.21.15.7:0/4044249154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0102000 msgr2=0x7f46b0197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46a7400640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0102000 0x7f46b0197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46a7400640 1 -- 172.21.15.7:0/4044249154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b0103bb0 msgr2=0x7f46b019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.390+0000 7f46a7400640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b0103bb0 0x7f46b019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46a7400640 1 -- 172.21.15.7:0/4044249154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0009840 con 0x7f46b01031f0 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46b4a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b0103bb0 0x7f46b019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46a7400640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b01031f0 0x7f46b0198420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f469800e9f0 tx=0x7f469800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46ad600640 1 -- 172.21.15.7:0/4044249154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698009720 con 0x7f46b01031f0 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46ad600640 1 -- 172.21.15.7:0/4044249154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f469800cd80 con 0x7f46b01031f0 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46ad600640 1 -- 172.21.15.7:0/4044249154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698010430 con 0x7f46b01031f0 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a8009560 con 0x7f46b01031f0 2024-09-13T18:16:37.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.391+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b01a0280 con 0x7f46b01031f0 2024-09-13T18:16:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.392+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b0102400 con 0x7f46b01031f0 2024-09-13T18:16:37.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.394+0000 7f46ad600640 1 -- 172.21.15.7:0/4044249154 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f4698005020 con 0x7f46b01031f0 2024-09-13T18:16:37.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.395+0000 7f46ad600640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46940a11a0 0x7f46940a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.395+0000 7f46ad600640 1 -- 172.21.15.7:0/4044249154 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4698014070 con 0x7f46b01031f0 2024-09-13T18:16:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.396+0000 7f46afe00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46940a11a0 0x7f46940a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.396+0000 7f46afe00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46940a11a0 0x7f46940a3660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f46b0103050 tx=0x7f46a0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:37.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.399+0000 7f46ad600640 1 -- 172.21.15.7:0/4044249154 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f46980963a0 con 0x7f46b01031f0 2024-09-13T18:16:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.579+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46b010d9c0 con 0x7f46b01031f0 2024-09-13T18:16:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.581+0000 7f46ad600640 1 -- 172.21.15.7:0/4044249154 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7f46980999c0 con 0x7f46b01031f0 2024-09-13T18:16:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:37.584 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:16:37.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46940a11a0 msgr2=0x7f46940a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46940a11a0 0x7f46940a3660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f46b0103050 tx=0x7f46a0009500 comp rx=0 tx=0).stop 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b01031f0 msgr2=0x7f46b0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b01031f0 0x7f46b0198420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f469800e9f0 tx=0x7f469800edf0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 shutdown_connections 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46940a11a0 0x7f46940a3660 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b0103bb0 0x7f46b019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b01031f0 0x7f46b0198420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 --2- 172.21.15.7:0/4044249154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46b0102000 0x7f46b0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 >> 172.21.15.7:0/4044249154 conn(0x7f46b00fd760 msgr2=0x7f46b0106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 shutdown_connections 2024-09-13T18:16:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.583+0000 7f46b6a00640 1 -- 172.21.15.7:0/4044249154 wait complete. 2024-09-13T18:16:37.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:15:04.217247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:15:05.500183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:16:37.603 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:16:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.761+0000 7fdad7000640 1 -- 172.21.15.7:0/1540924155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0101f30 msgr2=0x7fdad0102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.761+0000 7fdad7000640 1 --2- 172.21.15.7:0/1540924155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0101f30 0x7fdad0102330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009900 tx=0x7fdac002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.762+0000 7fdad7000640 1 -- 172.21.15.7:0/1540924155 shutdown_connections 2024-09-13T18:16:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.762+0000 7fdad7000640 1 --2- 172.21.15.7:0/1540924155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdad0103a40 0x7fdad010a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.762+0000 7fdad7000640 1 --2- 172.21.15.7:0/1540924155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0103080 0x7fdad0103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.762+0000 7fdad7000640 1 --2- 172.21.15.7:0/1540924155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0101f30 0x7fdad0102330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.762+0000 7fdad7000640 1 -- 172.21.15.7:0/1540924155 >> 172.21.15.7:0/1540924155 conn(0x7fdad00fd6b0 msgr2=0x7fdad00ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.762+0000 7fdad7000640 1 -- 172.21.15.7:0/1540924155 shutdown_connections 2024-09-13T18:16:37.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.762+0000 7fdad7000640 1 -- 172.21.15.7:0/1540924155 wait complete. 2024-09-13T18:16:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 Processor -- start 2024-09-13T18:16:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 -- start start 2024-09-13T18:16:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0101f30 0x7fdad0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdad0103080 0x7fdad0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0103a40 0x7fdad019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad019f9d0 con 0x7fdad0101f30 2024-09-13T18:16:37.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad019fb40 con 0x7fdad0103080 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad7000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad019fd00 con 0x7fdad0103a40 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdacfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0101f30 0x7fdad0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdacfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0101f30 0x7fdad0197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57324/0 (socket says 172.21.15.7:57324) 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdacfe00640 1 -- 172.21.15.7:0/130633795 learned_addr learned my addr 172.21.15.7:0/130633795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdac7400640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdad0103080 0x7fdad0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.763+0000 7fdad5000640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0103a40 0x7fdad019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacfe00640 1 -- 172.21.15.7:0/130633795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0103a40 msgr2=0x7fdad019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacfe00640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0103a40 0x7fdad019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacfe00640 1 -- 172.21.15.7:0/130633795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdad0103080 msgr2=0x7fdad0198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacfe00640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdad0103080 0x7fdad0198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacfe00640 1 -- 172.21.15.7:0/130633795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0009560 con 0x7fdad0101f30 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdac7400640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdad0103080 0x7fdad0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:37.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacfe00640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0101f30 0x7fdad0197ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdac0031500 tx=0x7fdac00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacd600640 1 -- 172.21.15.7:0/130633795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0004b50 con 0x7fdad0101f30 2024-09-13T18:16:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacd600640 1 -- 172.21.15.7:0/130633795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdac0004cb0 con 0x7fdad0101f30 2024-09-13T18:16:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad019ff80 con 0x7fdad0101f30 2024-09-13T18:16:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdacd600640 1 -- 172.21.15.7:0/130633795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0031a60 con 0x7fdad0101f30 2024-09-13T18:16:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.764+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad01a0400 con 0x7fdad0101f30 2024-09-13T18:16:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.766+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad01093d0 con 0x7fdad0101f30 2024-09-13T18:16:37.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.767+0000 7fdacd600640 1 -- 172.21.15.7:0/130633795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fdac0031bc0 con 0x7fdad0101f30 2024-09-13T18:16:37.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.768+0000 7fdacd600640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdab40a11a0 0x7fdab40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.769+0000 7fdacd600640 1 -- 172.21.15.7:0/130633795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdac00ed9a0 con 0x7fdad0101f30 2024-09-13T18:16:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.769+0000 7fdac7400640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdab40a11a0 0x7fdab40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:37.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.769+0000 7fdac7400640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdab40a11a0 0x7fdab40a3660 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdad01993f0 tx=0x7fdab8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:37.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.772+0000 7fdacd600640 1 -- 172.21.15.7:0/130633795 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdac00b6f80 con 0x7fdad0101f30 2024-09-13T18:16:37.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.953+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdad002c410 con 0x7fdad0101f30 2024-09-13T18:16:37.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.953+0000 7fdacd600640 1 -- 172.21.15.7:0/130633795 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdac0040020 con 0x7fdad0101f30 2024-09-13T18:16:37.956 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdab40a11a0 msgr2=0x7fdab40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdab40a11a0 0x7fdab40a3660 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdad01993f0 tx=0x7fdab8005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0101f30 msgr2=0x7fdad0197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0101f30 0x7fdad0197ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdac0031500 tx=0x7fdac00055a0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 shutdown_connections 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdab40a11a0 0x7fdab40a3660 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdad0103a40 0x7fdad019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdad0103080 0x7fdad0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 --2- 172.21.15.7:0/130633795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdad0101f30 0x7fdad0197ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:37.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.955+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 >> 172.21.15.7:0/130633795 conn(0x7fdad00fd6b0 msgr2=0x7fdad01065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:37.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.956+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 shutdown_connections 2024-09-13T18:16:37.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:37.956+0000 7fdad7000640 1 -- 172.21.15.7:0/130633795 wait complete. 2024-09-13T18:16:37.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:37 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1805461969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:16:37.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:37 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2003581478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:37.973 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:37 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/4044249154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:37.974 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:16:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:37 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1805461969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:16:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:37 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2003581478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:37 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/4044249154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:38.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 -- 172.21.15.7:0/3979853264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 msgr2=0x7fb35c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 --2- 172.21.15.7:0/3979853264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c103610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb348009900 tx=0x7fb34802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 -- 172.21.15.7:0/3979853264 shutdown_connections 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 --2- 172.21.15.7:0/3979853264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb35c103b50 0x7fb35c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 --2- 172.21.15.7:0/3979853264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c103610 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 --2- 172.21.15.7:0/3979853264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c101fa0 0x7fb35c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 -- 172.21.15.7:0/3979853264 >> 172.21.15.7:0/3979853264 conn(0x7fb35c0fd720 msgr2=0x7fb35c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 -- 172.21.15.7:0/3979853264 shutdown_connections 2024-09-13T18:16:38.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.132+0000 7fb361c00640 1 -- 172.21.15.7:0/3979853264 wait complete. 2024-09-13T18:16:38.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 Processor -- start 2024-09-13T18:16:38.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 -- start start 2024-09-13T18:16:38.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb35c101fa0 0x7fb35c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c103b50 0x7fb35c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c19fa60 con 0x7fb35c103190 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c19fbd0 con 0x7fb35c103b50 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.133+0000 7fb361c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c19fd90 con 0x7fb35c101fa0 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57340/0 (socket says 172.21.15.7:57340) 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 -- 172.21.15.7:0/1597705246 learned_addr learned my addr 172.21.15.7:0/1597705246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35aa00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb35c101fa0 0x7fb35c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35b400640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c103b50 0x7fb35c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 -- 172.21.15.7:0/1597705246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb35c101fa0 msgr2=0x7fb35c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb35c101fa0 0x7fb35c197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 -- 172.21.15.7:0/1597705246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c103b50 msgr2=0x7fb35c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c103b50 0x7fb35c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 -- 172.21.15.7:0/1597705246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348009560 con 0x7fb35c103190 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35aa00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb35c101fa0 0x7fb35c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.134+0000 7fb35a000640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c1984b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb348031500 tx=0x7fb348003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.135+0000 7fb353400640 1 -- 172.21.15.7:0/1597705246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348003e00 con 0x7fb35c103190 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.135+0000 7fb353400640 1 -- 172.21.15.7:0/1597705246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb348031c70 con 0x7fb35c103190 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.135+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c1a0010 con 0x7fb35c103190 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.135+0000 7fb353400640 1 -- 172.21.15.7:0/1597705246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34803bc20 con 0x7fb35c103190 2024-09-13T18:16:38.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.135+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c1a04c0 con 0x7fb35c103190 2024-09-13T18:16:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.136+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c109400 con 0x7fb35c103190 2024-09-13T18:16:38.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.138+0000 7fb353400640 1 -- 172.21.15.7:0/1597705246 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7fb3480317b0 con 0x7fb35c103190 2024-09-13T18:16:38.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.139+0000 7fb353400640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb3400a1120 0x7fb3400a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.139+0000 7fb353400640 1 -- 172.21.15.7:0/1597705246 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb3480ed2d0 con 0x7fb35c103190 2024-09-13T18:16:38.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.139+0000 7fb35aa00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb3400a1120 0x7fb3400a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.140+0000 7fb35aa00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb3400a1120 0x7fb3400a35e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb35c102ff0 tx=0x7fb34c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:38.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.143+0000 7fb353400640 1 -- 172.21.15.7:0/1597705246 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb3480b69c0 con 0x7fb35c103190 2024-09-13T18:16:38.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:37 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1805461969' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:16:38.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:37 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2003581478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:38.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:37 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/4044249154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:38.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.322+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb35c108e70 con 0x7fb35c103190 2024-09-13T18:16:38.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.323+0000 7fb353400640 1 -- 172.21.15.7:0/1597705246 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3480b9fe0 con 0x7fb35c103190 2024-09-13T18:16:38.325 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb3400a1120 msgr2=0x7fb3400a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb3400a1120 0x7fb3400a35e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb35c102ff0 tx=0x7fb34c005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 msgr2=0x7fb35c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c1984b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb348031500 tx=0x7fb348003c10 comp rx=0 tx=0).stop 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 shutdown_connections 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb3400a1120 0x7fb3400a35e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb35c103b50 0x7fb35c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb35c103190 0x7fb35c1984b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 --2- 172.21.15.7:0/1597705246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb35c101fa0 0x7fb35c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.325+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 >> 172.21.15.7:0/1597705246 conn(0x7fb35c0fd720 msgr2=0x7fb35c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:38.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.326+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 shutdown_connections 2024-09-13T18:16:38.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.326+0000 7fb361c00640 1 -- 172.21.15.7:0/1597705246 wait complete. 2024-09-13T18:16:38.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:16:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.514+0000 7f28ed400640 1 -- 172.21.15.7:0/2769733135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e81066d0 msgr2=0x7f28e8106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.514+0000 7f28ed400640 1 --2- 172.21.15.7:0/2769733135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e81066d0 0x7f28e8106ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009ca0 tx=0x7f28e002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.514+0000 7f28ed400640 1 -- 172.21.15.7:0/2769733135 shutdown_connections 2024-09-13T18:16:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.514+0000 7f28ed400640 1 --2- 172.21.15.7:0/2769733135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e8107f60 0x7f28e810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.514+0000 7f28ed400640 1 --2- 172.21.15.7:0/2769733135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e81075a0 0x7f28e8107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.514+0000 7f28ed400640 1 --2- 172.21.15.7:0/2769733135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e81066d0 0x7f28e8106ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.514+0000 7f28ed400640 1 -- 172.21.15.7:0/2769733135 >> 172.21.15.7:0/2769733135 conn(0x7f28e80756f0 msgr2=0x7f28e8077b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.515+0000 7f28ed400640 1 -- 172.21.15.7:0/2769733135 shutdown_connections 2024-09-13T18:16:38.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.515+0000 7f28ed400640 1 -- 172.21.15.7:0/2769733135 wait complete. 2024-09-13T18:16:38.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.517+0000 7f28ed400640 1 Processor -- start 2024-09-13T18:16:38.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.518+0000 7f28ed400640 1 -- start start 2024-09-13T18:16:38.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.518+0000 7f28ed400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e81066d0 0x7f28e819c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.518+0000 7f28ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e81075a0 0x7f28e819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.518+0000 7f28ed400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e8107f60 0x7f28e81a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28ed400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e81a3eb0 con 0x7f28e81075a0 2024-09-13T18:16:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28ed400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e81a4020 con 0x7f28e81066d0 2024-09-13T18:16:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28ed400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e81a41e0 con 0x7f28e8107f60 2024-09-13T18:16:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e81066d0 0x7f28e819c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e81066d0 0x7f28e819c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55450/0 (socket says 172.21.15.7:55450) 2024-09-13T18:16:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 -- 172.21.15.7:0/224616126 learned_addr learned my addr 172.21.15.7:0/224616126 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:38.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e7200640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e8107f60 0x7f28e81a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e5e00640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e81075a0 0x7f28e819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 -- 172.21.15.7:0/224616126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e8107f60 msgr2=0x7f28e81a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e8107f60 0x7f28e81a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 -- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e81075a0 msgr2=0x7f28e819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e81075a0 0x7f28e819c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.519+0000 7f28e6800640 1 -- 172.21.15.7:0/224616126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0009900 con 0x7f28e81066d0 2024-09-13T18:16:38.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.520+0000 7f28e6800640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e81066d0 0x7f28e819c3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000f80 tx=0x7f28e0032f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:38.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.521+0000 7f28df400640 1 -- 172.21.15.7:0/224616126 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0003b70 con 0x7f28e81066d0 2024-09-13T18:16:38.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.521+0000 7f28df400640 1 -- 172.21.15.7:0/224616126 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28e0040070 con 0x7f28e81066d0 2024-09-13T18:16:38.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.521+0000 7f28df400640 1 -- 172.21.15.7:0/224616126 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0004540 con 0x7f28e81066d0 2024-09-13T18:16:38.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.521+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e81a4460 con 0x7f28e81066d0 2024-09-13T18:16:38.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.521+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e81a4920 con 0x7f28e81066d0 2024-09-13T18:16:38.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.524+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e810d840 con 0x7f28e81066d0 2024-09-13T18:16:38.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.529+0000 7f28df400640 1 -- 172.21.15.7:0/224616126 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 135923+0+0 (secure 0 0 0) 0x7f28e0042030 con 0x7f28e81066d0 2024-09-13T18:16:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.532+0000 7f28df400640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f28cc0a12f0 0x7f28cc0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.533+0000 7f28e5e00640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f28cc0a12f0 0x7f28cc0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.534+0000 7f28df400640 1 -- 172.21.15.7:0/224616126 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f28e00ede30 con 0x7f28e81066d0 2024-09-13T18:16:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.537+0000 7f28e5e00640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f28cc0a12f0 0x7f28cc0a37b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f28d4005d00 tx=0x7f28d4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.538+0000 7f28df400640 1 -- 172.21.15.7:0/224616126 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f28e00b7640 con 0x7f28e81066d0 2024-09-13T18:16:38.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.723+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28e8111d20 con 0x7f28e81066d0 2024-09-13T18:16:38.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.724+0000 7f28df400640 1 -- 172.21.15.7:0/224616126 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28e8111d20 con 0x7f28e81066d0 2024-09-13T18:16:38.727 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.726+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f28cc0a12f0 msgr2=0x7f28cc0a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.726+0000 7f28ed400640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f28cc0a12f0 0x7f28cc0a37b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f28d4005d00 tx=0x7f28d4005c50 comp rx=0 tx=0).stop 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.726+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e81066d0 msgr2=0x7f28e819c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.726+0000 7f28ed400640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e81066d0 0x7f28e819c3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000f80 tx=0x7f28e0032f00 comp rx=0 tx=0).stop 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 shutdown_connections 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f28cc0a12f0 0x7f28cc0a37b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28e8107f60 0x7f28e81a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28e81075a0 0x7f28e819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 --2- 172.21.15.7:0/224616126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28e81066d0 0x7f28e819c3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 >> 172.21.15.7:0/224616126 conn(0x7f28e80756f0 msgr2=0x7f28e810aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 shutdown_connections 2024-09-13T18:16:38.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.727+0000 7f28ed400640 1 -- 172.21.15.7:0/224616126 wait complete. 2024-09-13T18:16:38.748 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:16:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.908+0000 7f7335800640 1 -- 172.21.15.7:0/2282876421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 msgr2=0x7f7330109f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.908+0000 7f7335800640 1 --2- 172.21.15.7:0/2282876421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 0x7f7330109f30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ca0 tx=0x7f732802a950 comp rx=0 tx=0).stop 2024-09-13T18:16:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.908+0000 7f7335800640 1 -- 172.21.15.7:0/2282876421 shutdown_connections 2024-09-13T18:16:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.908+0000 7f7335800640 1 --2- 172.21.15.7:0/2282876421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 0x7f7330109f30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.908+0000 7f7335800640 1 --2- 172.21.15.7:0/2282876421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330072eb0 0x7f7330073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.908+0000 7f7335800640 1 --2- 172.21.15.7:0/2282876421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7330074490 0x7f73300728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.908+0000 7f7335800640 1 -- 172.21.15.7:0/2282876421 >> 172.21.15.7:0/2282876421 conn(0x7f73300fb340 msgr2=0x7f73300fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:38.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.909+0000 7f7335800640 1 -- 172.21.15.7:0/2282876421 shutdown_connections 2024-09-13T18:16:38.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.909+0000 7f7335800640 1 -- 172.21.15.7:0/2282876421 wait complete. 2024-09-13T18:16:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.909+0000 7f7335800640 1 Processor -- start 2024-09-13T18:16:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7335800640 1 -- start start 2024-09-13T18:16:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7335800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7330072eb0 0x7f7330197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7335800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330074490 0x7f73301982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7335800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 0x7f733019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7335800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733019f860 con 0x7f7330074490 2024-09-13T18:16:38.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7335800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733019f9d0 con 0x7f7330107a70 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7335800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733019fb90 con 0x7f7330072eb0 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f732f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330074490 0x7f73301982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f732f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330074490 0x7f73301982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57380/0 (socket says 172.21.15.7:57380) 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f732f400640 1 -- 172.21.15.7:0/616477038 learned_addr learned my addr 172.21.15.7:0/616477038 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f7334e00640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 0x7f733019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.910+0000 7f732fe00640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7330072eb0 0x7f7330197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732f400640 1 -- 172.21.15.7:0/616477038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7330072eb0 msgr2=0x7f7330197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732f400640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7330072eb0 0x7f7330197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732f400640 1 -- 172.21.15.7:0/616477038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 msgr2=0x7f733019f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732f400640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 0x7f733019f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732f400640 1 -- 172.21.15.7:0/616477038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c009490 con 0x7f7330074490 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f7334e00640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 0x7f733019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:38.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732f400640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330074490 0x7f73301982b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ea60 tx=0x7f731c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732cc00640 1 -- 172.21.15.7:0/616477038 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00cde0 con 0x7f7330074490 2024-09-13T18:16:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328009900 con 0x7f7330074490 2024-09-13T18:16:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732cc00640 1 -- 172.21.15.7:0/616477038 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f731c0035f0 con 0x7f7330074490 2024-09-13T18:16:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f732cc00640 1 -- 172.21.15.7:0/616477038 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0044e0 con 0x7f7330074490 2024-09-13T18:16:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.911+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73301a01a0 con 0x7f7330074490 2024-09-13T18:16:38.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.912+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7330106830 con 0x7f7330074490 2024-09-13T18:16:38.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.914+0000 7f732cc00640 1 -- 172.21.15.7:0/616477038 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f731c003a60 con 0x7f7330074490 2024-09-13T18:16:38.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.915+0000 7f732cc00640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f73140a1090 0x7f73140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:38.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.916+0000 7f732cc00640 1 -- 172.21.15.7:0/616477038 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f731c014070 con 0x7f7330074490 2024-09-13T18:16:38.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.916+0000 7f732fe00640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f73140a1090 0x7f73140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:38.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.916+0000 7f732fe00640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f73140a1090 0x7f73140a3550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7320009bd0 tx=0x7f7320005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:38.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:38.919+0000 7f732cc00640 1 -- 172.21.15.7:0/616477038 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f731c0964b0 con 0x7f7330074490 2024-09-13T18:16:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:38 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/130633795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:16:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:38 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1597705246' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:16:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:38 smithi067 ceph-mon[35103]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:38 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/224616126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:16:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:38 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/130633795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:16:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:38 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1597705246' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:16:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:38 smithi007 ceph-mon[30588]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:38 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/224616126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:16:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.136+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f733010d6b0 con 0x7f7330074490 2024-09-13T18:16:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.137+0000 7f732cc00640 1 -- 172.21.15.7:0/616477038 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10889 (secure 0 0 0) 0x7f731c099ad0 con 0x7f7330074490 2024-09-13T18:16:39.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:39.139 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:15:12.707791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:16:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T18:16:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f73140a1090 msgr2=0x7f73140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f73140a1090 0x7f73140a3550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7320009bd0 tx=0x7f7320005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330074490 msgr2=0x7f73301982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330074490 0x7f73301982b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ea60 tx=0x7f731c00ef20 comp rx=0 tx=0).stop 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 shutdown_connections 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f73140a1090 0x7f73140a3550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7330107a70 0x7f733019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7330074490 0x7f73301982b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 --2- 172.21.15.7:0/616477038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7330072eb0 0x7f7330197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 >> 172.21.15.7:0/616477038 conn(0x7f73300fb340 msgr2=0x7f7330103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 shutdown_connections 2024-09-13T18:16:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.139+0000 7f7335800640 1 -- 172.21.15.7:0/616477038 wait complete. 2024-09-13T18:16:39.158 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:16:39.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:38 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/130633795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:16:39.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:38 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1597705246' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:16:39.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:38 smithi116 ceph-mon[35109]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:39.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:38 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/224616126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 -- 172.21.15.7:0/982114313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 msgr2=0x7f9f18108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 --2- 172.21.15.7:0/982114313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18108210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009ca0 tx=0x7f9f1002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 -- 172.21.15.7:0/982114313 shutdown_connections 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 --2- 172.21.15.7:0/982114313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18108210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 --2- 172.21.15.7:0/982114313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f18100fc0 0x7f9f18101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 --2- 172.21.15.7:0/982114313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f180ffdd0 0x7f9f181001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 -- 172.21.15.7:0/982114313 >> 172.21.15.7:0/982114313 conn(0x7f9f180fb590 msgr2=0x7f9f180fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 -- 172.21.15.7:0/982114313 shutdown_connections 2024-09-13T18:16:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.313+0000 7f9f20200640 1 -- 172.21.15.7:0/982114313 wait complete. 2024-09-13T18:16:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.314+0000 7f9f20200640 1 Processor -- start 2024-09-13T18:16:39.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.314+0000 7f9f20200640 1 -- start start 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f20200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f180ffdd0 0x7f9f18074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f20200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f18100fc0 0x7f9f180728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f20200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f20200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18073540 con 0x7f9f18101980 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f20200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f180736b0 con 0x7f9f180ffdd0 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f20200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1819fd70 con 0x7f9f18100fc0 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57410/0 (socket says 172.21.15.7:57410) 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 -- 172.21.15.7:0/704899053 learned_addr learned my addr 172.21.15.7:0/704899053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1d800640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f180ffdd0 0x7f9f18074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1ce00640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f18100fc0 0x7f9f180728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 -- 172.21.15.7:0/704899053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f18100fc0 msgr2=0x7f9f180728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f18100fc0 0x7f9f180728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 -- 172.21.15.7:0/704899053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f180ffdd0 msgr2=0x7f9f18074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f180ffdd0 0x7f9f18074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.315+0000 7f9f1e200640 1 -- 172.21.15.7:0/704899053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c009490 con 0x7f9f18101980 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.316+0000 7f9f1e200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18072de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9f10003c20 tx=0x7f9f10003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.316+0000 7f9f16000640 1 -- 172.21.15.7:0/704899053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f100307c0 con 0x7f9f18101980 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.316+0000 7f9f16000640 1 -- 172.21.15.7:0/704899053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f10040070 con 0x7f9f18101980 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.316+0000 7f9f16000640 1 -- 172.21.15.7:0/704899053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f100044a0 con 0x7f9f18101980 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.316+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f10009900 con 0x7f9f18101980 2024-09-13T18:16:39.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.316+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f181a02b0 con 0x7f9f18101980 2024-09-13T18:16:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.317+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f181001d0 con 0x7f9f18101980 2024-09-13T18:16:39.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.319+0000 7f9f16000640 1 -- 172.21.15.7:0/704899053 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f9f10042030 con 0x7f9f18101980 2024-09-13T18:16:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.320+0000 7f9f16000640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9f000a1110 0x7f9f000a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.320+0000 7f9f16000640 1 -- 172.21.15.7:0/704899053 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9f100ede70 con 0x7f9f18101980 2024-09-13T18:16:39.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.320+0000 7f9f1d800640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9f000a1110 0x7f9f000a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.321+0000 7f9f1d800640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9f000a1110 0x7f9f000a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9f18100e20 tx=0x7f9f0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:39.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.324+0000 7f9f16000640 1 -- 172.21.15.7:0/704899053 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9f100b7610 con 0x7f9f18101980 2024-09-13T18:16:39.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.507+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f18107210 con 0x7f9f18101980 2024-09-13T18:16:39.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.508+0000 7f9f16000640 1 -- 172.21.15.7:0/704899053 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7f9f100bac30 con 0x7f9f18101980 2024-09-13T18:16:39.511 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:39.511 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9f000a1110 msgr2=0x7f9f000a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9f000a1110 0x7f9f000a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9f18100e20 tx=0x7f9f0c005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 msgr2=0x7f9f18072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18072de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9f10003c20 tx=0x7f9f10003c50 comp rx=0 tx=0).stop 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 shutdown_connections 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9f000a1110 0x7f9f000a35d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f18101980 0x7f9f18072de0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f18100fc0 0x7f9f180728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 --2- 172.21.15.7:0/704899053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f180ffdd0 0x7f9f18074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.510+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 >> 172.21.15.7:0/704899053 conn(0x7f9f180fb590 msgr2=0x7f9f181043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:39.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.511+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 shutdown_connections 2024-09-13T18:16:39.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.511+0000 7f9f20200640 1 -- 172.21.15.7:0/704899053 wait complete. 2024-09-13T18:16:39.530 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 -- 172.21.15.7:0/2550286494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c102fa0 msgr2=0x7ff56c105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 --2- 172.21.15.7:0/2550286494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c102fa0 0x7ff56c105390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff558009860 tx=0x7ff55802a340 comp rx=0 tx=0).stop 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 -- 172.21.15.7:0/2550286494 shutdown_connections 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 --2- 172.21.15.7:0/2550286494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 0x7ff56c107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 --2- 172.21.15.7:0/2550286494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c102fa0 0x7ff56c105390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 --2- 172.21.15.7:0/2550286494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff56c100670 0x7ff56c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 -- 172.21.15.7:0/2550286494 >> 172.21.15.7:0/2550286494 conn(0x7ff56c0fa270 msgr2=0x7ff56c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 -- 172.21.15.7:0/2550286494 shutdown_connections 2024-09-13T18:16:39.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.685+0000 7ff571e00640 1 -- 172.21.15.7:0/2550286494 wait complete. 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.686+0000 7ff571e00640 1 Processor -- start 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571e00640 1 -- start start 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c100670 0x7ff56c0fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff56c102fa0 0x7ff56c0fe620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 0x7ff56c0feb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0ff2c0 con 0x7ff56c1058d0 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0ff430 con 0x7ff56c100670 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c19fd30 con 0x7ff56c102fa0 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 0x7ff56c0feb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff570a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c100670 0x7ff56c0fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 0x7ff56c0feb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57428/0 (socket says 172.21.15.7:57428) 2024-09-13T18:16:39.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff571400640 1 -- 172.21.15.7:0/3601014681 learned_addr learned my addr 172.21.15.7:0/3601014681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.687+0000 7ff56be00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff56c102fa0 0x7ff56c0fe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571400640 1 -- 172.21.15.7:0/3601014681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff56c102fa0 msgr2=0x7ff56c0fe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571400640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff56c102fa0 0x7ff56c0fe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571400640 1 -- 172.21.15.7:0/3601014681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c100670 msgr2=0x7ff56c0fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571400640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c100670 0x7ff56c0fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571400640 1 -- 172.21.15.7:0/3601014681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009900 con 0x7ff56c1058d0 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff570a00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c100670 0x7ff56c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571400640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 0x7ff56c0feb60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c420 tx=0x7ff56400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff569600640 1 -- 172.21.15.7:0/3601014681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564009be0 con 0x7ff56c1058d0 2024-09-13T18:16:39.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff569600640 1 -- 172.21.15.7:0/3601014681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff564003e30 con 0x7ff56c1058d0 2024-09-13T18:16:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff558009490 con 0x7ff56c1058d0 2024-09-13T18:16:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff569600640 1 -- 172.21.15.7:0/3601014681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640042f0 con 0x7ff56c1058d0 2024-09-13T18:16:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.688+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c1a02d0 con 0x7ff56c1058d0 2024-09-13T18:16:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.689+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c103380 con 0x7ff56c1058d0 2024-09-13T18:16:39.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.691+0000 7ff569600640 1 -- 172.21.15.7:0/3601014681 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7ff56400a040 con 0x7ff56c1058d0 2024-09-13T18:16:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.693+0000 7ff569600640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff5540a1110 0x7ff5540a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.693+0000 7ff569600640 1 -- 172.21.15.7:0/3601014681 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff5640cc8f0 con 0x7ff56c1058d0 2024-09-13T18:16:39.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.693+0000 7ff570a00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff5540a1110 0x7ff5540a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:39.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.694+0000 7ff570a00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff5540a1110 0x7ff5540a35d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff560009fc0 tx=0x7ff560005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:39.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.697+0000 7ff569600640 1 -- 172.21.15.7:0/3601014681 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff564096030 con 0x7ff56c1058d0 2024-09-13T18:16:39.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:39 smithi007 ceph-mon[30588]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-13T18:16:39.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:39 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/616477038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:39.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:39 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/704899053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.914+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff56c0fbd60 con 0x7ff56c1058d0 2024-09-13T18:16:39.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.914+0000 7ff569600640 1 -- 172.21.15.7:0/3601014681 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10889 (secure 0 0 0) 0x7ff564099650 con 0x7ff56c1058d0 2024-09-13T18:16:39.917 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:39.917 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:15:12.707791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:16:39.917 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T18:16:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.916+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff5540a1110 msgr2=0x7ff5540a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.916+0000 7ff571e00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff5540a1110 0x7ff5540a35d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff560009fc0 tx=0x7ff560005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.916+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 msgr2=0x7ff56c0feb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.916+0000 7ff571e00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 0x7ff56c0feb60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c420 tx=0x7ff56400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 shutdown_connections 2024-09-13T18:16:39.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff5540a1110 0x7ff5540a35d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff56c1058d0 0x7ff56c0feb60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff56c102fa0 0x7ff56c0fe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 --2- 172.21.15.7:0/3601014681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff56c100670 0x7ff56c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 >> 172.21.15.7:0/3601014681 conn(0x7ff56c0fa270 msgr2=0x7ff56c101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 shutdown_connections 2024-09-13T18:16:39.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:39.917+0000 7ff571e00640 1 -- 172.21.15.7:0/3601014681 wait complete. 2024-09-13T18:16:39.936 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T18:15:06.002659+0000', 'modified': '2024-09-13T18:15:12.707791+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24581, 'mds_1': 24559, 'mds_2': 24538, 'mds_3': 24533, 'mds_4': 24526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14517': {'gid': 14517, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6841/4101588502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6840', 'nonce': 4101588502}, {'type': 'v1', 'addr': '172.21.15.7:6841', 'nonce': 4101588502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.67:6833/344470719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 344470719}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 344470719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24466': {'gid': 24466, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6833/3628414330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6832', 'nonce': 3628414330}, {'type': 'v1', 'addr': '172.21.15.116:6833', 'nonce': 3628414330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24473': {'gid': 24473, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6835/379477361', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 379477361}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 379477361}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24503': {'gid': 24503, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.67:6835/833350667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 833350667}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 833350667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24526': {'gid': 24526, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.116:6835/4071332946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 4071332946}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 4071332946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.67:6837/2829823752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6836', 'nonce': 2829823752}, {'type': 'v1', 'addr': '172.21.15.67:6837', 'nonce': 2829823752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.116:6837/1196913954', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 1196913954}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 1196913954}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24559': {'gid': 24559, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.116:6839/284751360', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 284751360}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 284751360}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6839/2314229455', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6838', 'nonce': 2314229455}, {'type': 'v1', 'addr': '172.21.15.67:6839', 'nonce': 2314229455}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:16:39.936 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-13T18:16:39.936 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 -- 172.21.15.7:0/4263019382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe8100fb0 msgr2=0x7fefe8101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 --2- 172.21.15.7:0/4263019382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe8100fb0 0x7fefe8101430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009900 tx=0x7fefd002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 -- 172.21.15.7:0/4263019382 shutdown_connections 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 --2- 172.21.15.7:0/4263019382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8101970 0x7fefe8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 --2- 172.21.15.7:0/4263019382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe8100fb0 0x7fefe8101430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 --2- 172.21.15.7:0/4263019382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefe80ffdc0 0x7fefe81001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 -- 172.21.15.7:0/4263019382 >> 172.21.15.7:0/4263019382 conn(0x7fefe80fb520 msgr2=0x7fefe80fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 -- 172.21.15.7:0/4263019382 shutdown_connections 2024-09-13T18:16:40.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.091+0000 7fefede00640 1 -- 172.21.15.7:0/4263019382 wait complete. 2024-09-13T18:16:40.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.092+0000 7fefede00640 1 Processor -- start 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.092+0000 7fefede00640 1 -- start start 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefede00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe80ffdc0 0x7fefe8195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8100fb0 0x7fefe8196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefede00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefe8101970 0x7fefe819d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefede00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe819d8c0 con 0x7fefe8100fb0 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefede00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe819da30 con 0x7fefe80ffdc0 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefede00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe819dbf0 con 0x7fefe8101970 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8100fb0 0x7fefe8196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8100fb0 0x7fefe8196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57454/0 (socket says 172.21.15.7:57454) 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 -- 172.21.15.7:0/1224272433 learned_addr learned my addr 172.21.15.7:0/1224272433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefe6a00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe80ffdc0 0x7fefe8195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefe7400640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefe8101970 0x7fefe819d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 -- 172.21.15.7:0/1224272433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefe8101970 msgr2=0x7fefe819d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefe8101970 0x7fefe819d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 -- 172.21.15.7:0/1224272433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe80ffdc0 msgr2=0x7fefe8195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe80ffdc0 0x7fefe8195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.093+0000 7fefdfe00640 1 -- 172.21.15.7:0/1224272433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0009840 con 0x7fefe8100fb0 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.094+0000 7fefdfe00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8100fb0 0x7fefe8196310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fefd0031500 tx=0x7fefd0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.094+0000 7fefeca00640 1 -- 172.21.15.7:0/1224272433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0005d50 con 0x7fefe8100fb0 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.094+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd0009560 con 0x7fefe8100fb0 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.094+0000 7fefeca00640 1 -- 172.21.15.7:0/1224272433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefd0003e00 con 0x7fefe8100fb0 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.094+0000 7fefeca00640 1 -- 172.21.15.7:0/1224272433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd003bb50 con 0x7fefe8100fb0 2024-09-13T18:16:40.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.094+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe819e190 con 0x7fefe8100fb0 2024-09-13T18:16:40.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.098+0000 7feff0922740 1 Processor -- start 2024-09-13T18:16:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.098+0000 7feff0922740 1 -- start start 2024-09-13T18:16:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefeca00640 1 -- 172.21.15.7:0/1224272433 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fefd003bcb0 con 0x7fefe8100fb0 2024-09-13T18:16:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7feff0922740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7147340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7feff0922740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7147880 0x5642d714c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7feff0922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d714edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7feff0922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d70acab0 con 0x5642d714c910 2024-09-13T18:16:40.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7feff0922740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d70aa240 con 0x5642d7146f40 2024-09-13T18:16:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7feff0922740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d70a5b30 con 0x5642d7147880 2024-09-13T18:16:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d714edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe6a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7147880 0x5642d714c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe6a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7147880 0x5642d714c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50372/0 (socket says 172.21.15.7:50372) 2024-09-13T18:16:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe6a00640 1 -- 172.21.15.7:0/4064294450 learned_addr learned my addr 172.21.15.7:0/4064294450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe7400640 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe7400640 1 -- 172.21.15.7:0/4064294450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7147880 msgr2=0x5642d714c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe7400640 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7147880 0x5642d714c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe7400640 1 -- 172.21.15.7:0/4064294450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 msgr2=0x5642d714edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe7400640 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d714edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.099+0000 7fefe7400640 1 -- 172.21.15.7:0/4064294450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d7070bd0 con 0x5642d7146f40 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.100+0000 7fefe7400640 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7147340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fefe0011540 tx=0x7fefe0011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6880bfd49762e45d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.100+0000 7fefdcc00640 1 -- 172.21.15.7:0/4064294450 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0004d20 con 0x5642d7146f40 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.100+0000 7fefdcc00640 1 -- 172.21.15.7:0/4064294450 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefe0004e80 con 0x5642d7146f40 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.100+0000 7fefdcc00640 1 -- 172.21.15.7:0/4064294450 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000f840 con 0x5642d7146f40 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.100+0000 7fefeca00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fefcc0a1090 0x7fefcc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.100+0000 7fefeca00640 1 -- 172.21.15.7:0/1224272433 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fefd00ed1c0 con 0x7fefe8100fb0 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.100+0000 7fefe6a00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fefcc0a1090 0x7fefcc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 -- 172.21.15.7:0/4064294450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 msgr2=0x5642d7147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7147340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fefe0011540 tx=0x7fefe0011a00 comp rx=0 tx=0).stop 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 -- 172.21.15.7:0/4064294450 shutdown_connections 2024-09-13T18:16:40.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d714edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7147880 0x5642d714c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 --2- 172.21.15.7:0/4064294450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7147340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 -- 172.21.15.7:0/4064294450 >> 172.21.15.7:0/4064294450 conn(0x5642d713e1a0 msgr2=0x5642d713e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 -- 172.21.15.7:0/4064294450 shutdown_connections 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 -- 172.21.15.7:0/4064294450 wait complete. 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7fefe6a00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fefcc0a1090 0x7fefcc0a3550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5642d713f020 tx=0x7fefd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.101+0000 7feff0922740 1 -- start start 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 1 Processor -- start 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7146f40 0x5642d7150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d71510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d7158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7047260 con 0x5642d714c910 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7046f00 con 0x5642d7147880 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d6e0cf20 con 0x5642d7146f40 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7feff0922740 10 client.0 _ll_register_callbacks cb 0x5642d709f1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7fefe7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d7158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d71510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d71510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55554/0 (socket says 172.21.15.7:55554) 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7fefdfe00640 1 -- 172.21.15.7:0/259672440 learned_addr learned my addr 172.21.15.7:0/259672440 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7fefe7400640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d7158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57462/0 (socket says 172.21.15.7:57462) 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.102+0000 7fefe6a00640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7146f40 0x5642d7150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefe7400640 1 -- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7146f40 msgr2=0x5642d7150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefe7400640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7146f40 0x5642d7150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefe7400640 1 -- 172.21.15.7:0/259672440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 msgr2=0x5642d71510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefe7400640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d71510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefe7400640 1 -- 172.21.15.7:0/259672440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe0009d80 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefdfe00640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d71510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefe7400640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d7158120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fefe001b040 tx=0x7fefe00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1deb891c2d681c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefd5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefd5600640 1 -- 172.21.15.7:0/259672440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0004150 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642d6d993c0 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefd5600640 1 -- 172.21.15.7:0/259672440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fefe0003a30 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7fefd5600640 1 -- 172.21.15.7:0/259672440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefe0003bf0 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7feff0922740 10 client.14928 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.103+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5642d70a41b0 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7fefd5600640 1 -- 172.21.15.7:0/259672440 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5642d6d993c0 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7fefd5600640 1 -- 172.21.15.7:0/259672440 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fefe0035070 con 0x5642d714c910 2024-09-13T18:16:40.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7feff0922740 10 client.14928 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7feff0922740 10 client.14928 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T18:16:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7feff0922740 20 client.14928 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7feff0922740 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d715cdb0 0x5642d7160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7feff0922740 4 client.14928 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:16:40.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.104+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 --> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642d6daa6c0 con 0x5642d715cdb0 2024-09-13T18:16:40.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.105+0000 7fefe6a00640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d715cdb0 0x5642d7160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.105+0000 7fefe6a00640 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d715cdb0 0x5642d7160f30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=be4423d2de0a2459 server_cookie=fb2ad99187bc2c54 in_seq=0 out_seq=0 2024-09-13T18:16:40.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.105+0000 7fefd5600640 10 client.14928 ms_handle_connect on v2:172.21.15.116:6834/4071332946 2024-09-13T18:16:40.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7fefd5600640 1 -- 172.21.15.7:0/259672440 <== mds.4 v2:172.21.15.116:6834/4071332946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5642d6daa6c0 con 0x5642d715cdb0 2024-09-13T18:16:40.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7fefd5600640 10 client.14928 handle_command_reply: tid=0 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 client.14928 shutdown 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 msgr2=0x5642d7158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d7158120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fefe001b040 tx=0x7fefe00043d0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 shutdown_connections 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d715cdb0 0x5642d7160f30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d714c910 0x5642d7158120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d71510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 --2- 172.21.15.7:0/259672440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d7146f40 0x5642d7150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7fefd5600640 0 client.14928 ms_handle_reset on v2:172.21.15.116:6834/4071332946 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 >> 172.21.15.7:0/259672440 conn(0x5642d713e1a0 msgr2=0x5642d713f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 shutdown_connections 2024-09-13T18:16:40.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 1 -- 172.21.15.7:0/259672440 wait complete. 2024-09-13T18:16:40.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.106+0000 7feff0922740 20 client.14928 trim_cache size 0 max 16384 2024-09-13T18:16:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 Processor -- start 2024-09-13T18:16:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 -- start start 2024-09-13T18:16:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7146f40 0x5642d7148700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d7148c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7158040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7158dc0 con 0x5642d7146f40 2024-09-13T18:16:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7147fd0 con 0x5642d7147880 2024-09-13T18:16:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7feff0922740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7132d80 con 0x5642d714c910 2024-09-13T18:16:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7146f40 0x5642d7148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7146f40 0x5642d7148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57472/0 (socket says 172.21.15.7:57472) 2024-09-13T18:16:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 -- 172.21.15.7:0/242442158 learned_addr learned my addr 172.21.15.7:0/242442158 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefdfe00640 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d7148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe7400640 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 -- 172.21.15.7:0/242442158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 msgr2=0x5642d7158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 -- 172.21.15.7:0/242442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 msgr2=0x5642d7148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d7148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.122+0000 7fefe6a00640 1 -- 172.21.15.7:0/242442158 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d7046470 con 0x5642d7146f40 2024-09-13T18:16:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.123+0000 7fefe6a00640 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7146f40 0x5642d7148700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5642d7150060 tx=0x7fefd8022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0742e2ef53b2f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.123+0000 7fefdd600640 1 -- 172.21.15.7:0/242442158 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8025040 con 0x5642d7146f40 2024-09-13T18:16:40.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.123+0000 7fefdd600640 1 -- 172.21.15.7:0/242442158 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefd80044a0 con 0x5642d7146f40 2024-09-13T18:16:40.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.123+0000 7fefdd600640 1 -- 172.21.15.7:0/242442158 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8017070 con 0x5642d7146f40 2024-09-13T18:16:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.123+0000 7feff0922740 1 -- 172.21.15.7:0/242442158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7146f40 msgr2=0x5642d7148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.123+0000 7feff0922740 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7146f40 0x5642d7148700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5642d7150060 tx=0x7fefd8022040 comp rx=0 tx=0).stop 2024-09-13T18:16:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 -- 172.21.15.7:0/242442158 shutdown_connections 2024-09-13T18:16:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7147880 0x5642d7148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 --2- 172.21.15.7:0/242442158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7146f40 0x5642d7148700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 -- 172.21.15.7:0/242442158 >> 172.21.15.7:0/242442158 conn(0x5642d713e1a0 msgr2=0x5642d714bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 -- 172.21.15.7:0/242442158 shutdown_connections 2024-09-13T18:16:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 -- 172.21.15.7:0/242442158 wait complete. 2024-09-13T18:16:40.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 -- start start 2024-09-13T18:16:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.124+0000 7feff0922740 1 Processor -- start 2024-09-13T18:16:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7feff0922740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7157d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7feff0922740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7147880 0x5642d71547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7feff0922740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7feff0922740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7155410 con 0x5642d7147880 2024-09-13T18:16:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7feff0922740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7158390 con 0x5642d7146f40 2024-09-13T18:16:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7feff0922740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d7158550 con 0x5642d714c910 2024-09-13T18:16:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7feff0922740 10 client.0 _ll_register_callbacks cb 0x7fefd00f0a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7147880 0x5642d71547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefe6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefe6a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55584/0 (socket says 172.21.15.7:55584) 2024-09-13T18:16:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefe6a00640 1 -- 172.21.15.7:0/233648916 learned_addr learned my addr 172.21.15.7:0/233648916 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefe7400640 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefdfe00640 1 -- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 msgr2=0x5642d7154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefdfe00640 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefdfe00640 1 -- 172.21.15.7:0/233648916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 msgr2=0x5642d7157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefdfe00640 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefdfe00640 1 -- 172.21.15.7:0/233648916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8012e90 con 0x5642d7147880 2024-09-13T18:16:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.125+0000 7fefe6a00640 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7fefdfe00640 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7147880 0x5642d71547d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fefd00f0960 tx=0x7fefd0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf64584eac34c559 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7fefd5600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7fefd5600640 1 -- 172.21.15.7:0/233648916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00ec050 con 0x5642d7147880 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7fefd5600640 1 -- 172.21.15.7:0/233648916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fefd00bacc0 con 0x5642d7147880 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642d70cfcd0 con 0x5642d7147880 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7fefd5600640 1 -- 172.21.15.7:0/233648916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd00ba100 con 0x5642d7147880 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 10 client.14934 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5642d706b980 con 0x5642d7147880 2024-09-13T18:16:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7fefd5600640 1 -- 172.21.15.7:0/233648916 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5642d70cfcd0 con 0x5642d7147880 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7fefd5600640 1 -- 172.21.15.7:0/233648916 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fefd00f0cb0 con 0x5642d7147880 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 10 client.14934 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 10 client.14934 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 20 client.14934 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d71b7600 0x5642d71b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 4 client.14934 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.126+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 --> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5642d6dfdd10 con 0x5642d71b7600 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.127+0000 7fefe6a00640 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d71b7600 0x5642d71b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.127+0000 7fefe6a00640 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d71b7600 0x5642d71b3f90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=418824339be3638 server_cookie=9a3d729b876b1d34 in_seq=0 out_seq=0 2024-09-13T18:16:40.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.127+0000 7fefd5600640 10 client.14934 ms_handle_connect on v2:172.21.15.116:6834/4071332946 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7fefd5600640 1 -- 172.21.15.7:0/233648916 <== mds.4 v2:172.21.15.116:6834/4071332946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5642d6dfdd10 con 0x5642d71b7600 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7fefd5600640 10 client.14934 handle_command_reply: tid=0 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 client.14934 shutdown 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7147880 msgr2=0x5642d71547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7147880 0x5642d71547d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fefd00f0960 tx=0x7fefd0036000 comp rx=0 tx=0).stop 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 shutdown_connections 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x5642d71b7600 0x5642d71b3f90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5642d714c910 0x5642d7154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5642d7147880 0x5642d71547d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 --2- 172.21.15.7:0/233648916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5642d7146f40 0x5642d7157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 >> 172.21.15.7:0/233648916 conn(0x5642d713e1a0 msgr2=0x5642d714bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7fefd5600640 0 client.14934 ms_handle_reset on v2:172.21.15.116:6834/4071332946 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 shutdown_connections 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 1 -- 172.21.15.7:0/233648916 wait complete. 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.128+0000 7feff0922740 20 client.14934 trim_cache size 0 max 16384 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-09-13T18:16:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24526, 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 88.076328591000006, 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:16:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 114.852637419 2024-09-13T18:16:40.148 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:16:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fefcc0a1090 msgr2=0x7fefcc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fefcc0a1090 0x7fefcc0a3550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5642d713f020 tx=0x7fefd8005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8100fb0 msgr2=0x7fefe8196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8100fb0 0x7fefe8196310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fefd0031500 tx=0x7fefd0003c10 comp rx=0 tx=0).stop 2024-09-13T18:16:40.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 shutdown_connections 2024-09-13T18:16:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fefcc0a1090 0x7fefcc0a3550 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefe8101970 0x7fefe819d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefe8100fb0 0x7fefe8196310 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 --2- 172.21.15.7:0/1224272433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fefe80ffdc0 0x7fefe8195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 >> 172.21.15.7:0/1224272433 conn(0x7fefe80fb520 msgr2=0x7fefe81044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 shutdown_connections 2024-09-13T18:16:40.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.129+0000 7fefede00640 1 -- 172.21.15.7:0/1224272433 wait complete. 2024-09-13T18:16:40.150 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T18:16:40.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:39 smithi116 ceph-mon[35109]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-13T18:16:40.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:39 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/616477038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:40.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:39 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/704899053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:40.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:39 smithi067 ceph-mon[35103]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-13T18:16:40.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:39 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/616477038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:40.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:39 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/704899053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:16:40.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.306+0000 7f8b10000640 1 -- 172.21.15.7:0/3254440227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b08101fd0 msgr2=0x7f8b081023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.306+0000 7f8b10000640 1 --2- 172.21.15.7:0/3254440227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b08101fd0 0x7f8b081023d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009900 tx=0x7f8afc02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.307+0000 7f8b10000640 1 -- 172.21.15.7:0/3254440227 shutdown_connections 2024-09-13T18:16:40.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.307+0000 7f8b10000640 1 --2- 172.21.15.7:0/3254440227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b08103b80 0x7f8b0810a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.307+0000 7f8b10000640 1 --2- 172.21.15.7:0/3254440227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b081031c0 0x7f8b08103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.307+0000 7f8b10000640 1 --2- 172.21.15.7:0/3254440227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b08101fd0 0x7f8b081023d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.307+0000 7f8b10000640 1 -- 172.21.15.7:0/3254440227 >> 172.21.15.7:0/3254440227 conn(0x7f8b080fd730 msgr2=0x7f8b080ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.307+0000 7f8b10000640 1 -- 172.21.15.7:0/3254440227 shutdown_connections 2024-09-13T18:16:40.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.307+0000 7f8b10000640 1 -- 172.21.15.7:0/3254440227 wait complete. 2024-09-13T18:16:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 Processor -- start 2024-09-13T18:16:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 -- start start 2024-09-13T18:16:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b08101fd0 0x7f8b08197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b081031c0 0x7f8b081984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b08103b80 0x7f8b0819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0819faa0 con 0x7f8b081031c0 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0819fc10 con 0x7f8b08103b80 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b10000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0819fdd0 con 0x7f8b08101fd0 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b0cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b081031c0 0x7f8b081984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b08101fd0 0x7f8b08197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b08101fd0 0x7f8b08197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50408/0 (socket says 172.21.15.7:50408) 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b0cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b081031c0 0x7f8b081984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57492/0 (socket says 172.21.15.7:57492) 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.308+0000 7f8b0d600640 1 -- 172.21.15.7:0/471476188 learned_addr learned my addr 172.21.15.7:0/471476188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0e000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b08103b80 0x7f8b0819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0cc00640 1 -- 172.21.15.7:0/471476188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b08101fd0 msgr2=0x7f8b08197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b08101fd0 0x7f8b08197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0cc00640 1 -- 172.21.15.7:0/471476188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b08103b80 msgr2=0x7f8b0819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b08103b80 0x7f8b0819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0cc00640 1 -- 172.21.15.7:0/471476188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009560 con 0x7f8b081031c0 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0d600640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b08101fd0 0x7f8b08197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b081031c0 0x7f8b081984f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8af400e9f0 tx=0x7f8af400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b06000640 1 -- 172.21.15.7:0/471476188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af400ccc0 con 0x7f8b081031c0 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b06000640 1 -- 172.21.15.7:0/471476188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8af400ce20 con 0x7f8b081031c0 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b06000640 1 -- 172.21.15.7:0/471476188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4004a00 con 0x7f8b081031c0 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.309+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b081a00b0 con 0x7f8b081031c0 2024-09-13T18:16:40.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.310+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b081a0570 con 0x7f8b081031c0 2024-09-13T18:16:40.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.312+0000 7f8b12dc7740 1 Processor -- start 2024-09-13T18:16:40.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.312+0000 7f8b12dc7740 1 -- start start 2024-09-13T18:16:40.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.312+0000 7f8b06000640 1 -- 172.21.15.7:0/471476188 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f8af4005020 con 0x7f8b081031c0 2024-09-13T18:16:40.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b85f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b86470 0x557402b8af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b8d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402aefab0 con 0x557402b8b500 2024-09-13T18:16:40.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402aed240 con 0x557402b86470 2024-09-13T18:16:40.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402ae8b30 con 0x557402b85b30 2024-09-13T18:16:40.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b0cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b8d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b86470 0x557402b8af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b0e000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b85f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b86470 0x557402b8af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55610/0 (socket says 172.21.15.7:55610) 2024-09-13T18:16:40.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b0cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b8d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57504/0 (socket says 172.21.15.7:57504) 2024-09-13T18:16:40.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.313+0000 7f8b0d600640 1 -- 172.21.15.7:0/1831455540 learned_addr learned my addr 172.21.15.7:0/1831455540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0d600640 1 -- 172.21.15.7:0/1831455540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 msgr2=0x557402b85f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0d600640 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b85f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0d600640 1 -- 172.21.15.7:0/1831455540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 msgr2=0x557402b8d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0d600640 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b8d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0d600640 1 -- 172.21.15.7:0/1831455540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557402ab3bd0 con 0x557402b86470 2024-09-13T18:16:40.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b8d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0d600640 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b86470 0x557402b8af30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009230 tx=0x7f8afc005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=246a6e8ffd584e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b06000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8af00a1110 0x7f8af00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b06000640 1 -- 172.21.15.7:0/471476188 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8af4014070 con 0x7f8b081031c0 2024-09-13T18:16:40.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8afaa00640 1 -- 172.21.15.7:0/1831455540 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0037f0 con 0x557402b86470 2024-09-13T18:16:40.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8b0e000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8af00a1110 0x7f8af00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8afaa00640 1 -- 172.21.15.7:0/1831455540 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8afc040070 con 0x557402b86470 2024-09-13T18:16:40.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.314+0000 7f8afaa00640 1 -- 172.21.15.7:0/1831455540 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc03c440 con 0x557402b86470 2024-09-13T18:16:40.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1831455540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b86470 msgr2=0x557402b8af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b86470 0x557402b8af30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009230 tx=0x7f8afc005c00 comp rx=0 tx=0).stop 2024-09-13T18:16:40.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b0e000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8af00a1110 0x7f8af00a35d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b00005fd0 tx=0x7f8b00009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1831455540 shutdown_connections 2024-09-13T18:16:40.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b8d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b86470 0x557402b8af30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1831455540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b85f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1831455540 >> 172.21.15.7:0/1831455540 conn(0x557402b811a0 msgr2=0x557402b815a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1831455540 shutdown_connections 2024-09-13T18:16:40.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.315+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1831455540 wait complete. 2024-09-13T18:16:40.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 -- start start 2024-09-13T18:16:40.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 Processor -- start 2024-09-13T18:16:40.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b85b30 0x557402b8f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402b96c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402a8a260 con 0x557402b85b30 2024-09-13T18:16:40.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402a89f00 con 0x557402b8b500 2024-09-13T18:16:40.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740284ff20 con 0x557402b86470 2024-09-13T18:16:40.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b12dc7740 10 client.0 _ll_register_callbacks cb 0x557402ae21a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.316+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b85b30 0x557402b8f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b85b30 0x557402b8f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57512/0 (socket says 172.21.15.7:57512) 2024-09-13T18:16:40.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 -- 172.21.15.7:0/2406819354 learned_addr learned my addr 172.21.15.7:0/2406819354 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0e000640 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402b96c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 -- 172.21.15.7:0/2406819354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 msgr2=0x557402b8fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 -- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 msgr2=0x557402b96c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402b96c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 -- 172.21.15.7:0/2406819354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0810ad10 con 0x557402b85b30 2024-09-13T18:16:40.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b0d600640 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b85b30 0x557402b8f6e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8afc006010 tx=0x7f8afc031890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ad16b064a639df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8aef400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:16:40.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8aef400640 1 -- 172.21.15.7:0/2406819354 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0037f0 con 0x557402b85b30 2024-09-13T18:16:40.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8aef400640 1 -- 172.21.15.7:0/2406819354 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8afc003950 con 0x557402b85b30 2024-09-13T18:16:40.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.317+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557402b12cd0 con 0x557402b85b30 2024-09-13T18:16:40.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8aef400640 1 -- 172.21.15.7:0/2406819354 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8afc003b10 con 0x557402b85b30 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 10 client.14946 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557402ae71b0 con 0x557402b85b30 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8aef400640 1 -- 172.21.15.7:0/2406819354 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8afc05d080 con 0x557402b85b30 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8aef400640 1 -- 172.21.15.7:0/2406819354 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8afc04e430 con 0x557402b85b30 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 10 client.14946 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 10 client.14946 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 20 client.14946 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402b9b930 0x557402b9fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 4 client.14946 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:16:40.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.318+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 --> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574027dc3c0 con 0x557402b9b930 2024-09-13T18:16:40.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.319+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402b9b930 0x557402b9fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.319+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402b9b930 0x557402b9fab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=76af41d47d5a86e9 server_cookie=2978ed86de816bdd in_seq=0 out_seq=0 2024-09-13T18:16:40.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.319+0000 7f8aef400640 10 client.14946 ms_handle_connect on v2:172.21.15.67:6836/2829823752 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8aef400640 1 -- 172.21.15.7:0/2406819354 <== mds.3 v2:172.21.15.67:6836/2829823752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5574027dc3c0 con 0x557402b9b930 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8aef400640 10 client.14946 handle_command_reply: tid=0 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 client.14946 shutdown 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b85b30 msgr2=0x557402b8f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b85b30 0x557402b8f6e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8afc006010 tx=0x7f8afc031890 comp rx=0 tx=0).stop 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 shutdown_connections 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402b9b930 0x557402b9fab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402b96c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/2406819354 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b85b30 0x557402b8f6e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 >> 172.21.15.7:0/2406819354 conn(0x557402b811a0 msgr2=0x557402b829b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.320+0000 7f8aef400640 0 client.14946 ms_handle_reset on v2:172.21.15.67:6836/2829823752 2024-09-13T18:16:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.321+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 shutdown_connections 2024-09-13T18:16:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.321+0000 7f8b12dc7740 1 -- 172.21.15.7:0/2406819354 wait complete. 2024-09-13T18:16:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.321+0000 7f8b12dc7740 20 client.14946 trim_cache size 0 max 16384 2024-09-13T18:16:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.336+0000 7f8b12dc7740 1 Processor -- start 2024-09-13T18:16:40.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.336+0000 7f8b12dc7740 1 -- start start 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.336+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b85b30 0x557402b8a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b96b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402b8f2b0 con 0x557402b8b500 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402b8e6c0 con 0x557402b85b30 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402ae18d0 con 0x557402b86470 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b96b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b96b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57518/0 (socket says 172.21.15.7:57518) 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b85b30 0x557402b8a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 -- 172.21.15.7:0/381384007 learned_addr learned my addr 172.21.15.7:0/381384007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 -- 172.21.15.7:0/381384007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 msgr2=0x557402b8ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 -- 172.21.15.7:0/381384007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b85b30 msgr2=0x557402b8a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b85b30 0x557402b8a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0e000640 1 -- 172.21.15.7:0/381384007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557402a89470 con 0x557402b8b500 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.337+0000 7f8b0d600640 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b85b30 0x557402b8a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b0e000640 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b96b80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8b00003e20 tx=0x7f8b0001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7238baa58bea61bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8afb400640 1 -- 172.21.15.7:0/381384007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00024040 con 0x557402b8b500 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8afb400640 1 -- 172.21.15.7:0/381384007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b0000fa60 con 0x557402b8b500 2024-09-13T18:16:40.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8afb400640 1 -- 172.21.15.7:0/381384007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00016070 con 0x557402b8b500 2024-09-13T18:16:40.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b12dc7740 1 -- 172.21.15.7:0/381384007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 msgr2=0x557402b96b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b96b80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8b00003e20 tx=0x7f8b0001a000 comp rx=0 tx=0).stop 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b12dc7740 1 -- 172.21.15.7:0/381384007 shutdown_connections 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b8b500 0x557402b96b80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b86470 0x557402b8ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/381384007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b85b30 0x557402b8a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.338+0000 7f8b12dc7740 1 -- 172.21.15.7:0/381384007 >> 172.21.15.7:0/381384007 conn(0x557402b811a0 msgr2=0x557402b872f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 -- 172.21.15.7:0/381384007 shutdown_connections 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 -- 172.21.15.7:0/381384007 wait complete. 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 -- start start 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 Processor -- start 2024-09-13T18:16:40.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b93ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b86470 0x557402b940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402bf1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402b94790 con 0x557402b86470 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402bf1cb0 con 0x557402b8b500 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557402bf1e20 con 0x557402b85b30 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.339+0000 7f8b12dc7740 10 client.0 _ll_register_callbacks cb 0x7f8af40d2060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b86470 0x557402b940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b86470 0x557402b940e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57532/0 (socket says 172.21.15.7:57532) 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 -- 172.21.15.7:0/1575528201 learned_addr learned my addr 172.21.15.7:0/1575528201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0e000640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402bf1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0d600640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b93ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 -- 172.21.15.7:0/1575528201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 msgr2=0x557402b93ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b93ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 -- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 msgr2=0x557402bf1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402bf1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 -- 172.21.15.7:0/1575528201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557402ae71b0 con 0x557402b86470 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0d600640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b93ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8b0cc00640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b86470 0x557402b940e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8af4099ba0 tx=0x7f8af4099aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db190157a0eddcab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.340+0000 7f8aef400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8aef400640 1 -- 172.21.15.7:0/1575528201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af409a310 con 0x557402b86470 2024-09-13T18:16:40.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8aef400640 1 -- 172.21.15.7:0/1575528201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8af4099c10 con 0x557402b86470 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8afc040070 con 0x557402b86470 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8aef400640 1 -- 172.21.15.7:0/1575528201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8af40b8020 con 0x557402b86470 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 10 client.14952 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f8b00003ad0 con 0x557402b86470 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8aef400640 1 -- 172.21.15.7:0/1575528201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8af407c080 con 0x557402b86470 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8aef400640 1 -- 172.21.15.7:0/1575528201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8af4099190 con 0x557402b86470 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 10 client.14952 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 10 client.14952 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 20 client.14952 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402bf6be0 0x557402bf3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 4 client.14952 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:16:40.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.341+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 --> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5574027ed6c0 con 0x557402bf6be0 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.342+0000 7f8b0d600640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402bf6be0 0x557402bf3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.342+0000 7f8b0d600640 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402bf6be0 0x557402bf3570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8c66eb68c038e144 server_cookie=12a6ed51cfb1e47d in_seq=0 out_seq=0 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.342+0000 7f8aef400640 10 client.14952 ms_handle_connect on v2:172.21.15.67:6836/2829823752 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.342+0000 7f8aef400640 1 -- 172.21.15.7:0/1575528201 <== mds.3 v2:172.21.15.67:6836/2829823752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5574027ed6c0 con 0x557402bf6be0 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.342+0000 7f8aef400640 10 client.14952 handle_command_reply: tid=0 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.342+0000 7f8b12dc7740 1 client.14952 shutdown 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b86470 msgr2=0x557402b940e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b86470 0x557402b940e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8af4099ba0 tx=0x7f8af4099aa0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 shutdown_connections 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557402bf6be0 0x557402bf3570 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557402b8b500 0x557402bf1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557402b86470 0x557402b940e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 --2- 172.21.15.7:0/1575528201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557402b85b30 0x557402b93ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8aef400640 0 client.14952 ms_handle_reset on v2:172.21.15.67:6836/2829823752 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 >> 172.21.15.7:0/1575528201 conn(0x557402b811a0 msgr2=0x557402b8f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 shutdown_connections 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 1 -- 172.21.15.7:0/1575528201 wait complete. 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.343+0000 7f8b12dc7740 20 client.14952 trim_cache size 0 max 16384 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:16:40.351 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24533, 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 89.297339796000003, 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 110.20386038300001 2024-09-13T18:16:40.352 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:16:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8af00a1110 msgr2=0x7f8af00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8af00a1110 0x7f8af00a35d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b00005fd0 tx=0x7f8b00009500 comp rx=0 tx=0).stop 2024-09-13T18:16:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b081031c0 msgr2=0x7f8b081984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b081031c0 0x7f8b081984f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8af400e9f0 tx=0x7f8af400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 shutdown_connections 2024-09-13T18:16:40.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8af00a1110 0x7f8af00a35d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b08103b80 0x7f8b0819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8b081031c0 0x7f8b081984f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 --2- 172.21.15.7:0/471476188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b08101fd0 0x7f8b08197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 >> 172.21.15.7:0/471476188 conn(0x7f8b080fd730 msgr2=0x7f8b080ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 shutdown_connections 2024-09-13T18:16:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.344+0000 7f8b10000640 1 -- 172.21.15.7:0/471476188 wait complete. 2024-09-13T18:16:40.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:16:40.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 -- 172.21.15.7:0/3397422753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 msgr2=0x7fa8cc103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 --2- 172.21.15.7:0/3397422753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc103630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009900 tx=0x7fa8b402a410 comp rx=0 tx=0).stop 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 -- 172.21.15.7:0/3397422753 shutdown_connections 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 --2- 172.21.15.7:0/3397422753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc103b70 0x7fa8cc10a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 --2- 172.21.15.7:0/3397422753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc103630 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 --2- 172.21.15.7:0/3397422753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8cc101fc0 0x7fa8cc1023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 -- 172.21.15.7:0/3397422753 >> 172.21.15.7:0/3397422753 conn(0x7fa8cc0fd720 msgr2=0x7fa8cc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 -- 172.21.15.7:0/3397422753 shutdown_connections 2024-09-13T18:16:40.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.518+0000 7fa8d3400640 1 -- 172.21.15.7:0/3397422753 wait complete. 2024-09-13T18:16:40.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 Processor -- start 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 -- start start 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8cc101fc0 0x7fa8cc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc103b70 0x7fa8cc19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc19fa50 con 0x7fa8cc1031b0 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc19fbc0 con 0x7fa8cc103b70 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.519+0000 7fa8d3400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc19fd80 con 0x7fa8cc101fc0 2024-09-13T18:16:40.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8d0a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8cc101fc0 0x7fa8cc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57538/0 (socket says 172.21.15.7:57538) 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8d0a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8cc101fc0 0x7fa8cc197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50470/0 (socket says 172.21.15.7:50470) 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 -- 172.21.15.7:0/4060634961 learned_addr learned my addr 172.21.15.7:0/4060634961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8d1400640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc103b70 0x7fa8cc19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 -- 172.21.15.7:0/4060634961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8cc101fc0 msgr2=0x7fa8cc197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8cc101fc0 0x7fa8cc197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 -- 172.21.15.7:0/4060634961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc103b70 msgr2=0x7fa8cc19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc103b70 0x7fa8cc19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 -- 172.21.15.7:0/4060634961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4009560 con 0x7fa8cc1031b0 2024-09-13T18:16:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.520+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc1984a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009a20 tx=0x7fa8b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.521+0000 7fa8ca000640 1 -- 172.21.15.7:0/4060634961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4004d80 con 0x7fa8cc1031b0 2024-09-13T18:16:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.521+0000 7fa8ca000640 1 -- 172.21.15.7:0/4060634961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8b4003ab0 con 0x7fa8cc1031b0 2024-09-13T18:16:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.521+0000 7fa8ca000640 1 -- 172.21.15.7:0/4060634961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4031c40 con 0x7fa8cc1031b0 2024-09-13T18:16:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.521+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc1a0000 con 0x7fa8cc1031b0 2024-09-13T18:16:40.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.521+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc1a0460 con 0x7fa8cc1031b0 2024-09-13T18:16:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.524+0000 7fa8d61d4740 1 Processor -- start 2024-09-13T18:16:40.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d61d4740 1 -- start start 2024-09-13T18:16:40.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72aecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72af1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8ca000640 1 -- 172.21.15.7:0/4060634961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fa8b4003c20 con 0x7fa8cc1031b0 2024-09-13T18:16:40.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72af49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72a56ab0 con 0x555e72aed470 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72a54240 con 0x555e72aecb30 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72a4fb30 con 0x555e72af2500 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72aecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72af1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72aecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55658/0 (socket says 172.21.15.7:55658) 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.525+0000 7fa8d1400640 1 -- 172.21.15.7:0/2080302573 learned_addr learned my addr 172.21.15.7:0/2080302573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72af49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8d1400640 1 -- 172.21.15.7:0/2080302573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 msgr2=0x555e72af49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8d1400640 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72af49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8d1400640 1 -- 172.21.15.7:0/2080302573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 msgr2=0x555e72af1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8d1400640 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72af1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8d1400640 1 -- 172.21.15.7:0/2080302573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e72a1abd0 con 0x555e72aecb30 2024-09-13T18:16:40.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8d1400640 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72aecf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009f90 tx=0x7fa8c4010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=957d588ada8d1e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8c2000640 1 -- 172.21.15.7:0/2080302573 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4011700 con 0x555e72aecb30 2024-09-13T18:16:40.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8c2000640 1 -- 172.21.15.7:0/2080302573 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8c4015070 con 0x555e72aecb30 2024-09-13T18:16:40.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.526+0000 7fa8c2000640 1 -- 172.21.15.7:0/2080302573 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4019c20 con 0x555e72aecb30 2024-09-13T18:16:40.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8ca000640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa8b00a1090 0x7fa8b00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8ca000640 1 -- 172.21.15.7:0/4060634961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8b40ed980 con 0x7fa8cc1031b0 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa8b00a1090 0x7fa8b00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 -- 172.21.15.7:0/2080302573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 msgr2=0x555e72aecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72aecf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009f90 tx=0x7fa8c4010860 comp rx=0 tx=0).stop 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 -- 172.21.15.7:0/2080302573 shutdown_connections 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72af49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72af1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/2080302573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72aecf30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 -- 172.21.15.7:0/2080302573 >> 172.21.15.7:0/2080302573 conn(0x555e72ae81a0 msgr2=0x555e72ae85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 -- 172.21.15.7:0/2080302573 shutdown_connections 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.527+0000 7fa8d61d4740 1 -- 172.21.15.7:0/2080302573 wait complete. 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa8b00a1090 0x7fa8b00a3550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x555e72ae9020 tx=0x7fa8bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 -- start start 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 Processor -- start 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72aecb30 0x555e72af6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72af6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72af2500 0x555e72afdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e729f1260 con 0x555e72af2500 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e729f0f00 con 0x555e72aed470 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e727b6f20 con 0x555e72aecb30 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d61d4740 10 client.0 _ll_register_callbacks cb 0x555e72a491a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.528+0000 7fa8d1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72af2500 0x555e72afdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72af2500 0x555e72afdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57556/0 (socket says 172.21.15.7:57556) 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 -- 172.21.15.7:0/765249614 learned_addr learned my addr 172.21.15.7:0/765249614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72af6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72aecb30 0x555e72af6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 -- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72aecb30 msgr2=0x555e72af6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72aecb30 0x555e72af6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 -- 172.21.15.7:0/765249614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 msgr2=0x555e72af6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72af6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 -- 172.21.15.7:0/765249614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c4009bf0 con 0x555e72af2500 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d1400640 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72af2500 0x555e72afdcc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009990 tx=0x7fa8c4004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9168f511bdc16de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8baa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:16:40.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8baa00640 1 -- 172.21.15.7:0/765249614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4004e00 con 0x555e72af2500 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8baa00640 1 -- 172.21.15.7:0/765249614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8c4019960 con 0x555e72af2500 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.529+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e72a79cd0 con 0x555e72af2500 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8baa00640 1 -- 172.21.15.7:0/765249614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8c4019b20 con 0x555e72af2500 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 10 client.14964 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555e72a4e1b0 con 0x555e72af2500 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8baa00640 1 -- 172.21.15.7:0/765249614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555e72a79cd0 con 0x555e72af2500 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8baa00640 1 -- 172.21.15.7:0/765249614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8c4005040 con 0x555e72af2500 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 10 client.14964 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 10 client.14964 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:16:40.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 20 client.14964 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b02b10 0x555e72b06cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 4 client.14964 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:16:40.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.530+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 --> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e727433c0 con 0x555e72b02b10 2024-09-13T18:16:40.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.531+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b02b10 0x555e72b06cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.531+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b02b10 0x555e72b06cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2dd3a1f68b4b6dc server_cookie=72fc79caef4fd3df in_seq=0 out_seq=0 2024-09-13T18:16:40.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.531+0000 7fa8baa00640 10 client.14964 ms_handle_connect on v2:172.21.15.116:6836/1196913954 2024-09-13T18:16:40.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8baa00640 1 -- 172.21.15.7:0/765249614 <== mds.2 v2:172.21.15.116:6836/1196913954 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555e727433c0 con 0x555e72b02b10 2024-09-13T18:16:40.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8baa00640 10 client.14964 handle_command_reply: tid=0 2024-09-13T18:16:40.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 client.14964 shutdown 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72af2500 msgr2=0x555e72afdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72af2500 0x555e72afdcc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009990 tx=0x7fa8c4004b50 comp rx=0 tx=0).stop 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 shutdown_connections 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b02b10 0x555e72b06cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72af2500 0x555e72afdcc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72af6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8baa00640 0 client.14964 ms_handle_reset on v2:172.21.15.116:6836/1196913954 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/765249614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72aecb30 0x555e72af6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 >> 172.21.15.7:0/765249614 conn(0x555e72ae81a0 msgr2=0x555e72ae99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 shutdown_connections 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.532+0000 7fa8d61d4740 1 -- 172.21.15.7:0/765249614 wait complete. 2024-09-13T18:16:40.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.533+0000 7fa8d61d4740 20 client.14964 trim_cache size 0 max 16384 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 Processor -- start 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 -- start start 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72af6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72afdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72b0acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72af6310 con 0x555e72aed470 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72aedbc0 con 0x555e72aecb30 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.548+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72afe120 con 0x555e72af2500 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72afdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72afdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57564/0 (socket says 172.21.15.7:57564) 2024-09-13T18:16:40.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 -- 172.21.15.7:0/1363403373 learned_addr learned my addr 172.21.15.7:0/1363403373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72af6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8d1400640 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72b0acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 -- 172.21.15.7:0/1363403373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 msgr2=0x555e72b0acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72b0acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 -- 172.21.15.7:0/1363403373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 msgr2=0x555e72af6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72af6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 -- 172.21.15.7:0/1363403373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e729f0470 con 0x555e72aed470 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.549+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72afdbe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40eb490 tx=0x7fa8b402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b0e183148a9216 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8c2a00640 1 -- 172.21.15.7:0/1363403373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40ba9d0 con 0x555e72aed470 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8c2a00640 1 -- 172.21.15.7:0/1363403373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8b40ba7f0 con 0x555e72aed470 2024-09-13T18:16:40.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8c2a00640 1 -- 172.21.15.7:0/1363403373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40b9230 con 0x555e72aed470 2024-09-13T18:16:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 -- 172.21.15.7:0/1363403373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 msgr2=0x555e72afdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72afdbe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40eb490 tx=0x7fa8b402a410 comp rx=0 tx=0).stop 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 -- 172.21.15.7:0/1363403373 shutdown_connections 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72b0acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aed470 0x555e72afdbe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/1363403373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aecb30 0x555e72af6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 -- 172.21.15.7:0/1363403373 >> 172.21.15.7:0/1363403373 conn(0x555e72ae81a0 msgr2=0x555e72af64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 -- 172.21.15.7:0/1363403373 shutdown_connections 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.550+0000 7fa8d61d4740 1 -- 172.21.15.7:0/1363403373 wait complete. 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 -- start start 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 Processor -- start 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aecb30 0x555e72afadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72afb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72afc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72afc710 con 0x555e72aecb30 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72afc880 con 0x555e72aed470 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e72afca40 con 0x555e72af2500 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d61d4740 10 client.0 _ll_register_callbacks cb 0x7fa8bc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.551+0000 7fa8d0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aecb30 0x555e72afadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72afb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8d1400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72afc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72afb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55682/0 (socket says 172.21.15.7:55682) 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 -- 172.21.15.7:0/819064973 learned_addr learned my addr 172.21.15.7:0/819064973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 -- 172.21.15.7:0/819064973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 msgr2=0x555e72afc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72afc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 -- 172.21.15.7:0/819064973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aecb30 msgr2=0x555e72afadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aecb30 0x555e72afadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 -- 172.21.15.7:0/819064973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc1a0460 con 0x555e72aed470 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aecb30 0x555e72afadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8c3e00640 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72afb300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40c2d30 tx=0x7fa8b40c3260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16472e5add4c4fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8baa00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8baa00640 1 -- 172.21.15.7:0/819064973 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4031da0 con 0x555e72aed470 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8baa00640 1 -- 172.21.15.7:0/819064973 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa8b40b9230 con 0x555e72aed470 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.552+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8c4015070 con 0x555e72aed470 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8baa00640 1 -- 172.21.15.7:0/819064973 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8b40d91a0 con 0x555e72aed470 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 10 client.25031 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555e72a15980 con 0x555e72aed470 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8baa00640 1 -- 172.21.15.7:0/819064973 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8c4015070 con 0x555e72aed470 2024-09-13T18:16:40.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8baa00640 1 -- 172.21.15.7:0/819064973 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8b40ba380 con 0x555e72aed470 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 10 client.25031 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 10 client.25031 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 20 client.25031 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b5dbe0 0x555e72b5a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 4 client.25031 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 --> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555e727546c0 con 0x555e72b5dbe0 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.553+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b5dbe0 0x555e72b5a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d0a00640 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b5dbe0 0x555e72b5a980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71ac0f66679fa3f9 server_cookie=d2a22cc1dfcb9ea0 in_seq=0 out_seq=0 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8baa00640 10 client.25031 ms_handle_connect on v2:172.21.15.116:6836/1196913954 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8baa00640 1 -- 172.21.15.7:0/819064973 <== mds.2 v2:172.21.15.116:6836/1196913954 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555e727546c0 con 0x555e72b5dbe0 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8baa00640 10 client.25031 handle_command_reply: tid=0 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 client.25031 shutdown 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 msgr2=0x555e72afb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72afb300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40c2d30 tx=0x7fa8b40c3260 comp rx=0 tx=0).stop 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 shutdown_connections 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x555e72b5dbe0 0x555e72b5a980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555e72af2500 0x555e72afc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555e72aed470 0x555e72afb300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 --2- 172.21.15.7:0/819064973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555e72aecb30 0x555e72afadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 >> 172.21.15.7:0/819064973 conn(0x555e72ae81a0 msgr2=0x555e72b0b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.554+0000 7fa8baa00640 0 client.25031 ms_handle_reset on v2:172.21.15.116:6836/1196913954 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 shutdown_connections 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d61d4740 1 -- 172.21.15.7:0/819064973 wait complete. 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d61d4740 20 client.25031 trim_cache size 0 max 16384 2024-09-13T18:16:40.563 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24538, 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 90.521186459999996, 2024-09-13T18:16:40.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:16:40.565 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:16:40.565 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:16:40.565 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 112.852304359 2024-09-13T18:16:40.565 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:16:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa8b00a1090 msgr2=0x7fa8b00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa8b00a1090 0x7fa8b00a3550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x555e72ae9020 tx=0x7fa8bc00b410 comp rx=0 tx=0).stop 2024-09-13T18:16:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 msgr2=0x7fa8cc1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc1984a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009a20 tx=0x7fa8b40046c0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 shutdown_connections 2024-09-13T18:16:40.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa8b00a1090 0x7fa8b00a3550 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc103b70 0x7fa8cc19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8cc1031b0 0x7fa8cc1984a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 --2- 172.21.15.7:0/4060634961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8cc101fc0 0x7fa8cc197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 >> 172.21.15.7:0/4060634961 conn(0x7fa8cc0fd720 msgr2=0x7fa8cc106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.555+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 shutdown_connections 2024-09-13T18:16:40.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.556+0000 7fa8d3400640 1 -- 172.21.15.7:0/4060634961 wait complete. 2024-09-13T18:16:40.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T18:16:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.728+0000 7f1b75800640 1 -- 172.21.15.7:0/2213275016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70101dd0 msgr2=0x7f1b701021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.728+0000 7f1b75800640 1 --2- 172.21.15.7:0/2213275016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70101dd0 0x7f1b701021d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009900 tx=0x7f1b6002a410 comp rx=0 tx=0).stop 2024-09-13T18:16:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 -- 172.21.15.7:0/2213275016 shutdown_connections 2024-09-13T18:16:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 --2- 172.21.15.7:0/2213275016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b70103980 0x7f1b7010a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 --2- 172.21.15.7:0/2213275016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b70102fc0 0x7f1b70103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 --2- 172.21.15.7:0/2213275016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70101dd0 0x7f1b701021d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 -- 172.21.15.7:0/2213275016 >> 172.21.15.7:0/2213275016 conn(0x7f1b700fd530 msgr2=0x7f1b700ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 -- 172.21.15.7:0/2213275016 shutdown_connections 2024-09-13T18:16:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 -- 172.21.15.7:0/2213275016 wait complete. 2024-09-13T18:16:40.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.729+0000 7f1b75800640 1 Processor -- start 2024-09-13T18:16:40.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b75800640 1 -- start start 2024-09-13T18:16:40.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b75800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b70101dd0 0x7f1b70197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b75800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70102fc0 0x7f1b70198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b75800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b70103980 0x7f1b7019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b75800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7019f8d0 con 0x7f1b70102fc0 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b75800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7019fa40 con 0x7f1b70103980 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b75800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7019fc00 con 0x7f1b70101dd0 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70102fc0 0x7f1b70198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b70101dd0 0x7f1b70197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70102fc0 0x7f1b70198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57586/0 (socket says 172.21.15.7:57586) 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b67400640 1 -- 172.21.15.7:0/653009738 learned_addr learned my addr 172.21.15.7:0/653009738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b70101dd0 0x7f1b70197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50528/0 (socket says 172.21.15.7:50528) 2024-09-13T18:16:40.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.730+0000 7f1b74e00640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b70103980 0x7f1b7019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b67400640 1 -- 172.21.15.7:0/653009738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b70101dd0 msgr2=0x7f1b70197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b67400640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b70101dd0 0x7f1b70197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b67400640 1 -- 172.21.15.7:0/653009738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b70103980 msgr2=0x7f1b7019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b67400640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b70103980 0x7f1b7019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b67400640 1 -- 172.21.15.7:0/653009738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60009560 con 0x7f1b70102fc0 2024-09-13T18:16:40.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b74e00640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b70103980 0x7f1b7019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b67400640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70102fc0 0x7f1b70198370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800e9f0 tx=0x7f1b5800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b6d600640 1 -- 172.21.15.7:0/653009738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58009700 con 0x7f1b70102fc0 2024-09-13T18:16:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b6d600640 1 -- 172.21.15.7:0/653009738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b5800cd80 con 0x7f1b70102fc0 2024-09-13T18:16:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b6d600640 1 -- 172.21.15.7:0/653009738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58018860 con 0x7f1b70102fc0 2024-09-13T18:16:40.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7019fee0 con 0x7f1b70102fc0 2024-09-13T18:16:40.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.731+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b701a0310 con 0x7f1b70102fc0 2024-09-13T18:16:40.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.734+0000 7f1b79c90740 1 Processor -- start 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.734+0000 7f1b6d600640 1 -- 172.21.15.7:0/653009738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f1b580189c0 con 0x7f1b70102fc0 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.734+0000 7f1b79c90740 1 -- start start 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef5620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef5625e0 0x5591ef5670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef569b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b79c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef4cbab0 con 0x5591ef561ca0 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b79c90740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef4c9240 con 0x5591ef567670 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b79c90740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef4c4b30 con 0x5591ef5625e0 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef5620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef5620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57596/0 (socket says 172.21.15.7:57596) 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 -- 172.21.15.7:0/1708610528 learned_addr learned my addr 172.21.15.7:0/1708610528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef5625e0 0x5591ef5670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b67400640 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef569b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 -- 172.21.15.7:0/1708610528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef5625e0 msgr2=0x5591ef5670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef5625e0 0x5591ef5670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 -- 172.21.15.7:0/1708610528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 msgr2=0x5591ef569b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef569b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b74e00640 1 -- 172.21.15.7:0/1708610528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ef48fbd0 con 0x5591ef561ca0 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.735+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef5625e0 0x5591ef5670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.736+0000 7f1b74e00640 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef5620a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009fd0 tx=0x7f1b680108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cabcfc1352f452 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.736+0000 7f1b6d600640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b540a1090 0x7f1b540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.736+0000 7f1b65600640 1 -- 172.21.15.7:0/1708610528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68011760 con 0x5591ef561ca0 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.736+0000 7f1b65600640 1 -- 172.21.15.7:0/1708610528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b68015070 con 0x5591ef561ca0 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.736+0000 7f1b65600640 1 -- 172.21.15.7:0/1708610528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6801bd00 con 0x5591ef561ca0 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.736+0000 7f1b6d600640 1 -- 172.21.15.7:0/653009738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1b58014070 con 0x7f1b70102fc0 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.736+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b540a1090 0x7f1b540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 -- 172.21.15.7:0/1708610528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 msgr2=0x5591ef5620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef5620a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009fd0 tx=0x7f1b680108e0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 -- 172.21.15.7:0/1708610528 shutdown_connections 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef569b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef5625e0 0x5591ef5670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 --2- 172.21.15.7:0/1708610528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef5620a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 -- 172.21.15.7:0/1708610528 >> 172.21.15.7:0/1708610528 conn(0x5591ef55d310 msgr2=0x5591ef55d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b540a1090 0x7f1b540a3550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b60031500 tx=0x7f1b60005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 -- 172.21.15.7:0/1708610528 shutdown_connections 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 -- 172.21.15.7:0/1708610528 wait complete. 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 -- start start 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.737+0000 7f1b79c90740 1 Processor -- start 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef56b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef567670 0x5591ef572ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b79c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef466260 con 0x5591ef567670 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b79c90740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef465f00 con 0x5591ef5625e0 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b79c90740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef22bf20 con 0x5591ef561ca0 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b79c90740 10 client.0 _ll_register_callbacks cb 0x5591ef4be1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b74e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef567670 0x5591ef572ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b67400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b74e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef567670 0x5591ef572ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57604/0 (socket says 172.21.15.7:57604) 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b67400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55714/0 (socket says 172.21.15.7:55714) 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b74e00640 1 -- 172.21.15.7:0/4207377065 learned_addr learned my addr 172.21.15.7:0/4207377065 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.738+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef56b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b67400640 1 -- 172.21.15.7:0/4207377065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 msgr2=0x5591ef56b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b67400640 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef56b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b67400640 1 -- 172.21.15.7:0/4207377065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef567670 msgr2=0x5591ef572ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b67400640 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef567670 0x5591ef572ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b67400640 1 -- 172.21.15.7:0/4207377065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b68009cb0 con 0x5591ef5625e0 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b74e00640 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef567670 0x5591ef572ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b67400640 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56be60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b580ca790 tx=0x7f1b58009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce469abc419a526b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b5e000640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b5e000640 1 -- 172.21.15.7:0/4207377065 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580999f0 con 0x5591ef5625e0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b5e000640 1 -- 172.21.15.7:0/4207377065 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1b5809a790 con 0x5591ef5625e0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591ef4eecd0 con 0x5591ef5625e0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b5e000640 1 -- 172.21.15.7:0/4207377065 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b5809a090 con 0x5591ef5625e0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b79c90740 10 client.25043 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.739+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591ef4c31b0 con 0x5591ef5625e0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b5e000640 1 -- 172.21.15.7:0/4207377065 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5591ef4eecd0 con 0x5591ef5625e0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b5e000640 1 -- 172.21.15.7:0/4207377065 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1b58098ff0 con 0x5591ef5625e0 2024-09-13T18:16:40.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b79c90740 10 client.25043 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b79c90740 10 client.25043 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b79c90740 20 client.25043 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b79c90740 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef577de0 0x5591ef57bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b79c90740 4 client.25043 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 --> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591ef1b83c0 con 0x5591ef577de0 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.740+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef577de0 0x5591ef57bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.741+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef577de0 0x5591ef57bf40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed7acbf47be0d7e8 server_cookie=4f57f04a6f62ed05 in_seq=0 out_seq=0 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.741+0000 7f1b5e000640 10 client.25043 ms_handle_connect on v2:172.21.15.116:6838/284751360 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.741+0000 7f1b5e000640 1 -- 172.21.15.7:0/4207377065 <== mds.1 v2:172.21.15.116:6838/284751360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5591ef1b83c0 con 0x5591ef577de0 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.741+0000 7f1b5e000640 10 client.25043 handle_command_reply: tid=0 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 client.25043 shutdown 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 msgr2=0x5591ef56be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56be60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b580ca790 tx=0x7f1b58009310 comp rx=0 tx=0).stop 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 shutdown_connections 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef577de0 0x5591ef57bf40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef567670 0x5591ef572ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56be60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b5e000640 0 client.25043 ms_handle_reset on v2:172.21.15.116:6838/284751360 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 --2- 172.21.15.7:0/4207377065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef56b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 >> 172.21.15.7:0/4207377065 conn(0x5591ef55d310 msgr2=0x5591ef55c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 shutdown_connections 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 1 -- 172.21.15.7:0/4207377065 wait complete. 2024-09-13T18:16:40.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.742+0000 7f1b79c90740 20 client.25043 trim_cache size 0 max 16384 2024-09-13T18:16:40.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 Processor -- start 2024-09-13T18:16:40.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 -- start start 2024-09-13T18:16:40.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef562080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef5625e0 0x5591ef572e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef56bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef562d30 con 0x5591ef5625e0 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef579b60 con 0x5591ef567670 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b79c90740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef1b83c0 con 0x5591ef561ca0 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b67400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef5625e0 0x5591ef572e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef562080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b74e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef56bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef562080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50560/0 (socket says 172.21.15.7:50560) 2024-09-13T18:16:40.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.758+0000 7f1b6fe00640 1 -- 172.21.15.7:0/3307772901 learned_addr learned my addr 172.21.15.7:0/3307772901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.759+0000 7f1b6fe00640 1 -- 172.21.15.7:0/3307772901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 msgr2=0x5591ef56bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.759+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/3307772901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef56bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.759+0000 7f1b6fe00640 1 -- 172.21.15.7:0/3307772901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef5625e0 msgr2=0x5591ef572e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.759+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/3307772901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef5625e0 0x5591ef572e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.759+0000 7f1b6fe00640 1 -- 172.21.15.7:0/3307772901 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ef465470 con 0x5591ef561ca0 2024-09-13T18:16:40.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.759+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/3307772901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef562080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b70102e20 tx=0x7f1b60040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7dd39589a66245 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.763+0000 7f1b66000640 1 -- 172.21.15.7:0/3307772901 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6004d040 con 0x5591ef561ca0 2024-09-13T18:16:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.763+0000 7f1b66000640 1 -- 172.21.15.7:0/3307772901 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b60003d90 con 0x5591ef561ca0 2024-09-13T18:16:40.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.763+0000 7f1b66000640 1 -- 172.21.15.7:0/3307772901 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b600319a0 con 0x5591ef561ca0 2024-09-13T18:16:40.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 -- 172.21.15.7:0/3307772901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 msgr2=0x5591ef562080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 --2- 172.21.15.7:0/3307772901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef562080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b70102e20 tx=0x7f1b60040000 comp rx=0 tx=0).stop 2024-09-13T18:16:40.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 -- 172.21.15.7:0/3307772901 shutdown_connections 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 --2- 172.21.15.7:0/3307772901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef567670 0x5591ef56bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 --2- 172.21.15.7:0/3307772901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef5625e0 0x5591ef572e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 --2- 172.21.15.7:0/3307772901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef561ca0 0x5591ef562080 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 -- 172.21.15.7:0/3307772901 >> 172.21.15.7:0/3307772901 conn(0x5591ef55d310 msgr2=0x5591ef56b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 -- 172.21.15.7:0/3307772901 shutdown_connections 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 -- 172.21.15.7:0/3307772901 wait complete. 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 -- start start 2024-09-13T18:16:40.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.764+0000 7f1b79c90740 1 Processor -- start 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef56dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b79c90740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef567670 0x5591ef5cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b79c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef56e700 con 0x5591ef561ca0 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b79c90740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef56e870 con 0x5591ef5625e0 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b79c90740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef5ce140 con 0x5591ef567670 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b79c90740 10 client.0 _ll_register_callbacks cb 0x7f1b5800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b6fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef56dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55736/0 (socket says 172.21.15.7:55736) 2024-09-13T18:16:40.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 -- 172.21.15.7:0/588464020 learned_addr learned my addr 172.21.15.7:0/588464020 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b74e00640 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef567670 0x5591ef5cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 -- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef567670 msgr2=0x5591ef5cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef567670 0x5591ef5cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 -- 172.21.15.7:0/588464020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 msgr2=0x5591ef56dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef56dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b67400640 1 -- 172.21.15.7:0/588464020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600044d0 con 0x5591ef5625e0 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.765+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef56dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b67400640 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56e1c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b580ca790 tx=0x7f1b58010d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327febe08eaec77e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b5e000640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b5e000640 1 -- 172.21.15.7:0/588464020 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580d0570 con 0x5591ef5625e0 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b68015070 con 0x5591ef5625e0 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b5e000640 1 -- 172.21.15.7:0/588464020 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1b580a2510 con 0x5591ef5625e0 2024-09-13T18:16:40.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b5e000640 1 -- 172.21.15.7:0/588464020 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b58099e60 con 0x5591ef5625e0 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b79c90740 10 client.25049 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.766+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591ef48a980 con 0x5591ef5625e0 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b5e000640 1 -- 172.21.15.7:0/588464020 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b68015070 con 0x5591ef5625e0 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b5e000640 1 -- 172.21.15.7:0/588464020 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1b580b81e0 con 0x5591ef5625e0 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b79c90740 10 client.25049 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b79c90740 10 client.25049 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b79c90740 20 client.25049 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b79c90740 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef5d2930 0x5591ef5cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b79c90740 4 client.25049 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 --> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5591ef1c96c0 con 0x5591ef5d2930 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.767+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef5d2930 0x5591ef5cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b6fe00640 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef5d2930 0x5591ef5cf400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=de06220dd1367647 server_cookie=49a165eddfd192ec in_seq=0 out_seq=0 2024-09-13T18:16:40.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b5e000640 10 client.25049 ms_handle_connect on v2:172.21.15.116:6838/284751360 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b5e000640 1 -- 172.21.15.7:0/588464020 <== mds.1 v2:172.21.15.116:6838/284751360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5591ef1c96c0 con 0x5591ef5d2930 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b5e000640 10 client.25049 handle_command_reply: tid=0 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 client.25049 shutdown 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 msgr2=0x5591ef56e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56e1c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b580ca790 tx=0x7f1b58010d00 comp rx=0 tx=0).stop 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 shutdown_connections 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x5591ef5d2930 0x5591ef5cf400 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5591ef567670 0x5591ef5cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b5e000640 0 client.25049 ms_handle_reset on v2:172.21.15.116:6838/284751360 2024-09-13T18:16:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5591ef5625e0 0x5591ef56e1c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 --2- 172.21.15.7:0/588464020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5591ef561ca0 0x5591ef56dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 >> 172.21.15.7:0/588464020 conn(0x5591ef55d310 msgr2=0x5591ef57ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 shutdown_connections 2024-09-13T18:16:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 1 -- 172.21.15.7:0/588464020 wait complete. 2024-09-13T18:16:40.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.768+0000 7f1b79c90740 20 client.25049 trim_cache size 0 max 16384 2024-09-13T18:16:40.775 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24559, 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 91.739298661999996, 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 108.200962625 2024-09-13T18:16:40.776 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:16:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b540a1090 msgr2=0x7f1b540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b540a1090 0x7f1b540a3550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b60031500 tx=0x7f1b60005780 comp rx=0 tx=0).stop 2024-09-13T18:16:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70102fc0 msgr2=0x7f1b70198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70102fc0 0x7f1b70198370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800e9f0 tx=0x7f1b5800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 shutdown_connections 2024-09-13T18:16:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1b540a1090 0x7f1b540a3550 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b70103980 0x7f1b7019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b70102fc0 0x7f1b70198370 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 --2- 172.21.15.7:0/653009738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b70101dd0 0x7f1b70197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 >> 172.21.15.7:0/653009738 conn(0x7f1b700fd530 msgr2=0x7f1b701064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 shutdown_connections 2024-09-13T18:16:40.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.769+0000 7f1b75800640 1 -- 172.21.15.7:0/653009738 wait complete. 2024-09-13T18:16:40.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:16:40.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:40 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3601014681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:40.834 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:40 smithi007 ceph-mon[30588]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 -- 172.21.15.7:0/3203071790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0ffdc0 msgr2=0x7f3c9c1001c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 --2- 172.21.15.7:0/3203071790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0ffdc0 0x7f3c9c1001c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009860 tx=0x7f3c8c02a340 comp rx=0 tx=0).stop 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 -- 172.21.15.7:0/3203071790 shutdown_connections 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 --2- 172.21.15.7:0/3203071790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c9c101970 0x7f3c9c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 --2- 172.21.15.7:0/3203071790 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c100fb0 0x7f3c9c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 --2- 172.21.15.7:0/3203071790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c0ffdc0 0x7f3c9c1001c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 -- 172.21.15.7:0/3203071790 >> 172.21.15.7:0/3203071790 conn(0x7f3c9c0fb520 msgr2=0x7f3c9c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 -- 172.21.15.7:0/3203071790 shutdown_connections 2024-09-13T18:16:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.942+0000 7f3ca1800640 1 -- 172.21.15.7:0/3203071790 wait complete. 2024-09-13T18:16:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.943+0000 7f3ca1800640 1 Processor -- start 2024-09-13T18:16:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.943+0000 7f3ca1800640 1 -- start start 2024-09-13T18:16:40.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3ca1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c0ffdc0 0x7f3c9c195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3ca1800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c100fb0 0x7f3c9c196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3ca1800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c9c101970 0x7f3c9c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3ca1800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c19d8e0 con 0x7f3c9c0ffdc0 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3ca1800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c19da50 con 0x7f3c9c100fb0 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3ca1800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c19dc10 con 0x7f3c9c101970 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c9aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c0ffdc0 0x7f3c9c195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c100fb0 0x7f3c9c196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c100fb0 0x7f3c9c196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55748/0 (socket says 172.21.15.7:55748) 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 -- 172.21.15.7:0/1733205404 learned_addr learned my addr 172.21.15.7:0/1733205404 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c9c101970 0x7f3c9c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 -- 172.21.15.7:0/1733205404 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c9c101970 msgr2=0x7f3c9c19d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c9c101970 0x7f3c9c19d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 -- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c0ffdc0 msgr2=0x7f3c9c195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c0ffdc0 0x7f3c9c195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c93e00640 1 -- 172.21.15.7:0/1733205404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c84009560 con 0x7f3c9c100fb0 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.944+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c9c101970 0x7f3c9c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.945+0000 7f3c93e00640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c100fb0 0x7f3c9c196330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400e9c0 tx=0x7f3c8400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.945+0000 7f3c93400640 1 -- 172.21.15.7:0/1733205404 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400cde0 con 0x7f3c9c100fb0 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.945+0000 7f3c93400640 1 -- 172.21.15.7:0/1733205404 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c840035f0 con 0x7f3c9c100fb0 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.945+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c009490 con 0x7f3c9c100fb0 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.945+0000 7f3c93400640 1 -- 172.21.15.7:0/1733205404 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840044e0 con 0x7f3c9c100fb0 2024-09-13T18:16:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.945+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c19e210 con 0x7f3c9c100fb0 2024-09-13T18:16:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 Processor -- start 2024-09-13T18:16:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 -- start start 2024-09-13T18:16:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3c93400640 1 -- 172.21.15.7:0/1733205404 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f3c84003760 con 0x7f3c9c100fb0 2024-09-13T18:16:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc1509d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc15002ab0 con 0x55dc150a2910 2024-09-13T18:16:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc15000240 con 0x55dc1509d880 2024-09-13T18:16:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.948+0000 7f3ca4637740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc14ffbb30 con 0x55dc1509cf40 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc1509d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c93e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc1509d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50600/0 (socket says 172.21.15.7:50600) 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c9b400640 1 -- 172.21.15.7:0/1489173643 learned_addr learned my addr 172.21.15.7:0/1489173643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c93e00640 1 -- 172.21.15.7:0/1489173643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 msgr2=0x55dc1509d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c93e00640 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc1509d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c93e00640 1 -- 172.21.15.7:0/1489173643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 msgr2=0x55dc150a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c93e00640 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c93e00640 1 -- 172.21.15.7:0/1489173643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc14fc6bd0 con 0x55dc150a2910 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc1509d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.949+0000 7f3c93e00640 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a4dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ca8b0 tx=0x7f3c840d0ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb2cf0b49a57d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3c8be00640 1 -- 172.21.15.7:0/1489173643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840d5c90 con 0x55dc150a2910 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3c93400640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3c800a1090 0x7f3c800a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3c8be00640 1 -- 172.21.15.7:0/1489173643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c840d5df0 con 0x55dc150a2910 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3c8be00640 1 -- 172.21.15.7:0/1489173643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840d7650 con 0x55dc150a2910 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3c93400640 1 -- 172.21.15.7:0/1733205404 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3c84014070 con 0x7f3c9c100fb0 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3c800a1090 0x7f3c800a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3ca4637740 1 -- 172.21.15.7:0/1489173643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 msgr2=0x55dc150a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a4dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ca8b0 tx=0x7f3c840d0ca0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3ca4637740 1 -- 172.21.15.7:0/1489173643 shutdown_connections 2024-09-13T18:16:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a4dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1489173643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc1509d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.950+0000 7f3ca4637740 1 -- 172.21.15.7:0/1489173643 >> 172.21.15.7:0/1489173643 conn(0x55dc150941a0 msgr2=0x55dc150945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.951+0000 7f3ca4637740 1 -- 172.21.15.7:0/1489173643 shutdown_connections 2024-09-13T18:16:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.951+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3c800a1090 0x7f3c800a3550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005c40 tx=0x7f3c94009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.951+0000 7f3ca4637740 1 -- 172.21.15.7:0/1489173643 wait complete. 2024-09-13T18:16:40.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.951+0000 7f3ca4637740 1 -- start start 2024-09-13T18:16:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.951+0000 7f3ca4637740 1 Processor -- start 2024-09-13T18:16:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3ca4637740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc14f9d260 con 0x55dc150a2910 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3ca4637740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc14f9cf00 con 0x55dc1509d880 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3ca4637740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc14d62f20 con 0x55dc1509cf40 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3ca4637740 10 client.0 _ll_register_callbacks cb 0x55dc14ff51a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57650/0 (socket says 172.21.15.7:57650) 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9aa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 -- 172.21.15.7:0/73291759 learned_addr learned my addr 172.21.15.7:0/73291759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c93e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 -- 172.21.15.7:0/73291759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 msgr2=0x55dc150a6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 -- 172.21.15.7:0/73291759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 msgr2=0x55dc150a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.952+0000 7f3c9b400640 1 -- 172.21.15.7:0/73291759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c19e210 con 0x55dc150a2910 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3c9b400640 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ae120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c94012010 tx=0x7f3c94004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d90373d77f52250 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3c88c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3c88c00640 1 -- 172.21.15.7:0/73291759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94016070 con 0x55dc150a2910 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3c88c00640 1 -- 172.21.15.7:0/73291759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3c9401fd10 con 0x55dc150a2910 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc15025cd0 con 0x55dc150a2910 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3c88c00640 1 -- 172.21.15.7:0/73291759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c94027410 con 0x55dc150a2910 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3ca4637740 10 client.15000 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55dc14ffa1b0 con 0x55dc150a2910 2024-09-13T18:16:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3c88c00640 1 -- 172.21.15.7:0/73291759 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc15025cd0 con 0x55dc150a2910 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.953+0000 7f3c88c00640 1 -- 172.21.15.7:0/73291759 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3c9401c590 con 0x55dc150a2910 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3ca4637740 10 client.15000 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3ca4637740 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3ca4637740 20 client.15000 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3ca4637740 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc150b3140 0x55dc150b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3ca4637740 4 client.15000 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 --> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc14cef3c0 con 0x55dc150b3140 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc150b3140 0x55dc150b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc150b3140 0x55dc150b72e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=850f492448dae46f server_cookie=72e39028288de1a7 in_seq=0 out_seq=0 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.954+0000 7f3c88c00640 10 client.15000 ms_handle_connect on v2:172.21.15.67:6838/2314229455 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3c88c00640 1 -- 172.21.15.7:0/73291759 <== mds.0 v2:172.21.15.67:6838/2314229455 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55dc14cef3c0 con 0x55dc150b3140 2024-09-13T18:16:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3c88c00640 10 client.15000 handle_command_reply: tid=0 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 client.15000 shutdown 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 msgr2=0x55dc150ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ae120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3c94012010 tx=0x7f3c94004ab0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 shutdown_connections 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ae120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc150b3140 0x55dc150b72e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3ca4637740 1 --2- 172.21.15.7:0/73291759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.955+0000 7f3c88c00640 0 client.15000 ms_handle_reset on v2:172.21.15.67:6838/2314229455 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.956+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 >> 172.21.15.7:0/73291759 conn(0x55dc150941a0 msgr2=0x55dc150959b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.956+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 shutdown_connections 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.956+0000 7f3ca4637740 1 -- 172.21.15.7:0/73291759 wait complete. 2024-09-13T18:16:40.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.956+0000 7f3ca4637740 20 client.15000 trim_cache size 0 max 16384 2024-09-13T18:16:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 Processor -- start 2024-09-13T18:16:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 -- start start 2024-09-13T18:16:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509cf40 0x55dc1509d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509d880 0x55dc150ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc15025d00 con 0x55dc150a2910 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1509ce00 con 0x55dc1509cf40 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3ca4637740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc14ff48d0 con 0x55dc1509d880 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509cf40 0x55dc1509d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509cf40 0x55dc1509d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:55770/0 (socket says 172.21.15.7:55770) 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57664/0 (socket says 172.21.15.7:57664) 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 -- 172.21.15.7:0/3521451832 learned_addr learned my addr 172.21.15.7:0/3521451832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c93e00640 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509d880 0x55dc150ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 -- 172.21.15.7:0/3521451832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509d880 msgr2=0x55dc150ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509d880 0x55dc150ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 -- 172.21.15.7:0/3521451832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 msgr2=0x55dc150a7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.972+0000 7f3c9aa00640 1 -- 172.21.15.7:0/3521451832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc14f9c470 con 0x55dc1509cf40 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.973+0000 7f3c93e00640 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509d880 0x55dc150ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.973+0000 7f3c9b400640 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.973+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509cf40 0x55dc1509d320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c100e10 tx=0x7f3c8c0305a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4c420147d239aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.973+0000 7f3c90c00640 1 -- 172.21.15.7:0/3521451832 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0326c0 con 0x55dc1509cf40 2024-09-13T18:16:40.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.973+0000 7f3c90c00640 1 -- 172.21.15.7:0/3521451832 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c8c030680 con 0x55dc1509cf40 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.973+0000 7f3c90c00640 1 -- 172.21.15.7:0/3521451832 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c004040 con 0x55dc1509cf40 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 -- 172.21.15.7:0/3521451832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509cf40 msgr2=0x55dc1509d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509cf40 0x55dc1509d320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c100e10 tx=0x7f3c8c0305a0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 -- 172.21.15.7:0/3521451832 shutdown_connections 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150a7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509d880 0x55dc150ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 --2- 172.21.15.7:0/3521451832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509cf40 0x55dc1509d320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 -- 172.21.15.7:0/3521451832 >> 172.21.15.7:0/3521451832 conn(0x55dc150941a0 msgr2=0x55dc150a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 -- 172.21.15.7:0/3521451832 shutdown_connections 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 -- 172.21.15.7:0/3521451832 wait complete. 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 -- start start 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.974+0000 7f3ca4637740 1 Processor -- start 2024-09-13T18:16:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3ca4637740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3ca4637740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc150acad0 con 0x55dc150a2910 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3ca4637740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc150acc40 con 0x55dc1509d880 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3ca4637740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc150ace00 con 0x55dc1509cf40 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3ca4637740 10 client.0 _ll_register_callbacks cb 0x7f3c94011e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c93e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57672/0 (socket says 172.21.15.7:57672) 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 -- 172.21.15.7:0/1291581223 learned_addr learned my addr 172.21.15.7:0/1291581223 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 -- 172.21.15.7:0/1291581223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 msgr2=0x55dc150a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 -- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 msgr2=0x55dc150a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c9b400640 1 -- 172.21.15.7:0/1291581223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc14ffa1b0 con 0x55dc150a2910 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.975+0000 7f3c93e00640 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3c9b400640 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ac590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3c9401c940 tx=0x7f3c9401cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fa4f807d0b6b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3c88c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3c88c00640 1 -- 172.21.15.7:0/1291581223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94016050 con 0x55dc150a2910 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c840d5df0 con 0x55dc150a2910 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3c88c00640 1 -- 172.21.15.7:0/1291581223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3c940109d0 con 0x55dc150a2910 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3c88c00640 1 -- 172.21.15.7:0/1291581223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c9401f8c0 con 0x55dc150a2910 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3ca4637740 10 client.15006 fetch_fsmap learned FSMap version 26 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3c9c108b00 con 0x55dc150a2910 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.976+0000 7f3c88c00640 1 -- 172.21.15.7:0/1291581223 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c840d5df0 con 0x55dc150a2910 2024-09-13T18:16:40.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3c88c00640 1 -- 172.21.15.7:0/1291581223 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3c94039030 con 0x55dc150a2910 2024-09-13T18:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3ca4637740 10 client.15006 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3ca4637740 10 client.15006 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3ca4637740 20 client.15006 populate_metadata read hostname 'smithi007' 2024-09-13T18:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc1510e650 0x55dc1510afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3ca4637740 4 client.15006 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:16:40.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 --> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dc14d006c0 con 0x55dc1510e650 2024-09-13T18:16:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.977+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc1510e650 0x55dc1510afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3c9aa00640 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc1510e650 0x55dc1510afb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6779357cef915bc server_cookie=dcf2ca9c9be05b83 in_seq=0 out_seq=0 2024-09-13T18:16:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3c88c00640 10 client.15006 ms_handle_connect on v2:172.21.15.67:6838/2314229455 2024-09-13T18:16:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3c88c00640 1 -- 172.21.15.7:0/1291581223 <== mds.0 v2:172.21.15.67:6838/2314229455 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55dc14d006c0 con 0x55dc1510e650 2024-09-13T18:16:40.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3c88c00640 10 client.15006 handle_command_reply: tid=0 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 client.15006 shutdown 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 msgr2=0x55dc150ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ac590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3c9401c940 tx=0x7f3c9401cd90 comp rx=0 tx=0).stop 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 shutdown_connections 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc150a2910 0x55dc150ac590 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dc1509d880 0x55dc150a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55dc1510e650 0x55dc1510afb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 --2- 172.21.15.7:0/1291581223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dc1509cf40 0x55dc150a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3c88c00640 0 client.15006 ms_handle_reset on v2:172.21.15.67:6838/2314229455 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 >> 172.21.15.7:0/1291581223 conn(0x55dc150941a0 msgr2=0x55dc150bb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 shutdown_connections 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 1 -- 172.21.15.7:0/1291581223 wait complete. 2024-09-13T18:16:40.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.978+0000 7f3ca4637740 20 client.15006 trim_cache size 0 max 16384 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24581, 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 94.973045995999996, 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:16:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 99.552677693000007 2024-09-13T18:16:40.987 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:16:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3c800a1090 msgr2=0x7f3c800a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3c800a1090 0x7f3c800a3550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005c40 tx=0x7f3c94009500 comp rx=0 tx=0).stop 2024-09-13T18:16:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c100fb0 msgr2=0x7f3c9c196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:40.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c100fb0 0x7f3c9c196330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400e9c0 tx=0x7f3c8400ee80 comp rx=0 tx=0).stop 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 shutdown_connections 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3c800a1090 0x7f3c800a3550 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c9c101970 0x7f3c9c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c9c100fb0 0x7f3c9c196330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 --2- 172.21.15.7:0/1733205404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c9c0ffdc0 0x7f3c9c195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 >> 172.21.15.7:0/1733205404 conn(0x7f3c9c0fb520 msgr2=0x7f3c9c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 shutdown_connections 2024-09-13T18:16:40.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:40.979+0000 7f3ca1800640 1 -- 172.21.15.7:0/1733205404 wait complete. 2024-09-13T18:16:40.997 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T18:16:40.998 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:16:41.008 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T18:16:41.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T18:16:41.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:40 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3601014681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:41.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:40 smithi116 ceph-mon[35109]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:16:41.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:40 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3601014681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:16:41.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:40 smithi067 ceph-mon[35103]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:16:41.356 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:42.875 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:42 smithi007 ceph-mon[30588]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:16:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:42 smithi116 ceph-mon[35109]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:16:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:42 smithi067 ceph-mon[35103]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:16:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 -- 172.21.15.7:0/3742844065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc440744e0 msgr2=0x7fbc44072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:43.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 --2- 172.21.15.7:0/3742844065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc440744e0 0x7fbc44072940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009ca0 tx=0x7fbc3402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 -- 172.21.15.7:0/3742844065 shutdown_connections 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 --2- 172.21.15.7:0/3742844065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc4410c3c0 0x7fbc4410e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 --2- 172.21.15.7:0/3742844065 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc44072f10 0x7fbc44073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 --2- 172.21.15.7:0/3742844065 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc440744e0 0x7fbc44072940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 -- 172.21.15.7:0/3742844065 >> 172.21.15.7:0/3742844065 conn(0x7fbc440fb590 msgr2=0x7fbc440fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 -- 172.21.15.7:0/3742844065 shutdown_connections 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.276+0000 7fbc4a000640 1 -- 172.21.15.7:0/3742844065 wait complete. 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 Processor -- start 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 -- start start 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc44072f10 0x7fbc4419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc440744e0 0x7fbc4419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:43.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4410c3c0 0x7fbc441a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441a3e80 con 0x7fbc4410c3c0 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441a3ff0 con 0x7fbc44072f10 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc4a000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441a41b0 con 0x7fbc440744e0 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.278+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4410c3c0 0x7fbc441a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4410c3c0 0x7fbc441a3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57692/0 (socket says 172.21.15.7:57692) 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc44072f10 0x7fbc4419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 -- 172.21.15.7:0/2370907136 learned_addr learned my addr 172.21.15.7:0/2370907136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc3aa00640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc440744e0 0x7fbc4419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 -- 172.21.15.7:0/2370907136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc440744e0 msgr2=0x7fbc4419c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc440744e0 0x7fbc4419c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 -- 172.21.15.7:0/2370907136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc44072f10 msgr2=0x7fbc4419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:43.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc44072f10 0x7fbc4419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 -- 172.21.15.7:0/2370907136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc34009900 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc43e00640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4410c3c0 0x7fbc441a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00e970 tx=0x7fbc3c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.279+0000 7fbc40c00640 1 -- 172.21.15.7:0/2370907136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c009720 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.280+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc441a4490 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.280+0000 7fbc40c00640 1 -- 172.21.15.7:0/2370907136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc3c0054e0 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.280+0000 7fbc40c00640 1 -- 172.21.15.7:0/2370907136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c018430 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.280+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc441a4940 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.281+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc44101d60 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.282+0000 7fbc40c00640 1 -- 172.21.15.7:0/2370907136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fbc3c00ccc0 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.284+0000 7fbc40c00640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc280a10b0 0x7fbc280a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.284+0000 7fbc40c00640 1 -- 172.21.15.7:0/2370907136 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbc3c014070 con 0x7fbc4410c3c0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.284+0000 7fbc43400640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc280a10b0 0x7fbc280a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:43.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.285+0000 7fbc43400640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc280a10b0 0x7fbc280a3570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc34005e30 tx=0x7fbc34009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:43.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.288+0000 7fbc40c00640 1 -- 172.21.15.7:0/2370907136 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbc3c0964a0 con 0x7fbc4410c3c0 2024-09-13T18:16:43.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.482+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc440608f0 con 0x7fbc280a10b0 2024-09-13T18:16:43.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.484+0000 7fbc40c00640 1 -- 172.21.15.7:0/2370907136 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fbc440608f0 con 0x7fbc280a10b0 2024-09-13T18:16:43.486 INFO:teuthology.orchestra.run.smithi007.stdout:Backend: cephadm 2024-09-13T18:16:43.486 INFO:teuthology.orchestra.run.smithi007.stdout:Available: Yes 2024-09-13T18:16:43.486 INFO:teuthology.orchestra.run.smithi007.stdout:Paused: No 2024-09-13T18:16:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc280a10b0 msgr2=0x7fbc280a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc280a10b0 0x7fbc280a3570 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc34005e30 tx=0x7fbc34009800 comp rx=0 tx=0).stop 2024-09-13T18:16:43.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4410c3c0 msgr2=0x7fbc441a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4410c3c0 0x7fbc441a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00e970 tx=0x7fbc3c00ed70 comp rx=0 tx=0).stop 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 shutdown_connections 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbc280a10b0 0x7fbc280a3570 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc4410c3c0 0x7fbc441a3940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc440744e0 0x7fbc4419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 --2- 172.21.15.7:0/2370907136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc44072f10 0x7fbc4419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 >> 172.21.15.7:0/2370907136 conn(0x7fbc440fb590 msgr2=0x7fbc440fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 shutdown_connections 2024-09-13T18:16:43.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:43.487+0000 7fbc4a000640 1 -- 172.21.15.7:0/2370907136 wait complete. 2024-09-13T18:16:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:43 smithi007 ceph-mon[30588]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:43.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:43 smithi116 ceph-mon[35109]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:43.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:43 smithi067 ceph-mon[35103]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:44.235 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T18:16:44.556 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:44 smithi116 ceph-mon[35109]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:44.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:44 smithi007 ceph-mon[30588]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:44 smithi067 ceph-mon[35103]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 -- 172.21.15.7:0/484717395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001075f0 msgr2=0x7f0600107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 --2- 172.21.15.7:0/484717395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001075f0 0x7f0600107a70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009900 tx=0x7f05ec02a3e0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 -- 172.21.15.7:0/484717395 shutdown_connections 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 --2- 172.21.15.7:0/484717395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0600107fb0 0x7f060010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 --2- 172.21.15.7:0/484717395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06001075f0 0x7f0600107a70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 --2- 172.21.15.7:0/484717395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0600106750 0x7f0600106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 -- 172.21.15.7:0/484717395 >> 172.21.15.7:0/484717395 conn(0x7f06000756c0 msgr2=0x7f0600077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 -- 172.21.15.7:0/484717395 shutdown_connections 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.531+0000 7f0606000640 1 -- 172.21.15.7:0/484717395 wait complete. 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.532+0000 7f0606000640 1 Processor -- start 2024-09-13T18:16:46.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.532+0000 7f0606000640 1 -- start start 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f0606000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0600106750 0x7f060019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f0606000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06001075f0 0x7f060019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f0606000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600107fb0 0x7f06001a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f0606000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06001a3f30 con 0x7f0600107fb0 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f0606000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06001a40a0 con 0x7f06001075f0 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f0606000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06001a4260 con 0x7f0600106750 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f05fea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06001075f0 0x7f060019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600107fb0 0x7f06001a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f05fea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06001075f0 0x7f060019c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:34804/0 (socket says 172.21.15.7:34804) 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600107fb0 0x7f06001a39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44334/0 (socket says 172.21.15.7:44334) 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f05fea00640 1 -- 172.21.15.7:0/1384022247 learned_addr learned my addr 172.21.15.7:0/1384022247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.533+0000 7f05ff400640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0600106750 0x7f060019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05fea00640 1 -- 172.21.15.7:0/1384022247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0600106750 msgr2=0x7f060019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05fea00640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0600106750 0x7f060019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05fea00640 1 -- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600107fb0 msgr2=0x7f06001a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05fea00640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600107fb0 0x7f06001a39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05fea00640 1 -- 172.21.15.7:0/1384022247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec009560 con 0x7f06001075f0 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05ffe00640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600107fb0 0x7f06001a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05ff400640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0600106750 0x7f060019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05fea00640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06001075f0 0x7f060019c970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05ec031500 tx=0x7f05ec003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05f7e00640 1 -- 172.21.15.7:0/1384022247 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec003e00 con 0x7f06001075f0 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05f7e00640 1 -- 172.21.15.7:0/1384022247 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05ec031c70 con 0x7f06001075f0 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06001a44e0 con 0x7f06001075f0 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.534+0000 7f05f7e00640 1 -- 172.21.15.7:0/1384022247 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec03bc50 con 0x7f06001075f0 2024-09-13T18:16:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.535+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06001a4980 con 0x7f06001075f0 2024-09-13T18:16:46.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.536+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060010d8b0 con 0x7f06001075f0 2024-09-13T18:16:46.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.538+0000 7f05f7e00640 1 -- 172.21.15.7:0/1384022247 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f05ec0317b0 con 0x7f06001075f0 2024-09-13T18:16:46.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.539+0000 7f05f7e00640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f05e40a10b0 0x7f05e40a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:46.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.539+0000 7f05f7e00640 1 -- 172.21.15.7:0/1384022247 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f05ec0ed4e0 con 0x7f06001075f0 2024-09-13T18:16:46.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.539+0000 7f05ff400640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f05e40a10b0 0x7f05e40a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.540+0000 7f05ff400640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f05e40a10b0 0x7f05e40a3570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009fc0 tx=0x7f05f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.541+0000 7f05f7e00640 1 -- 172.21.15.7:0/1384022247 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f05ec0b6cd0 con 0x7f06001075f0 2024-09-13T18:16:46.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.730+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f060002c4c0 con 0x7f05e40a10b0 2024-09-13T18:16:46.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:46 smithi007 ceph-mon[30588]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:46.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.745+0000 7f05f7e00640 1 -- 172.21.15.7:0/1384022247 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4154 (secure 0 0 0) 0x7f060002c4c0 con 0x7f05e40a10b0 2024-09-13T18:16:46.747 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:16:46.747 INFO:teuthology.orchestra.run.smithi007.stdout:mds.a smithi007 running (108s) 19s ago 107s 15.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7d42e4c1aeb6 2024-09-13T18:16:46.747 INFO:teuthology.orchestra.run.smithi007.stdout:mds.b smithi067 running (105s) 38s ago 105s 25.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 e350fd39731f 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.c smithi116 running (119s) 38s ago 118s 17.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 42402498b308 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.d smithi007 running (2m) 19s ago 2m 12.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 0d6d21448b4a 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.e smithi067 running (2m) 38s ago 2m 20.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 722396f69cb4 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.f smithi116 running (2m) 38s ago 2m 17.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 df9b330ee129 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.g smithi007 running (111s) 19s ago 110s 12.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 cf13c7c6ff91 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.h smithi067 running (116s) 38s ago 116s 16.1M - 18.2.4-860-g6c6b083f 8a91f241d7d4 418d363034d3 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.i smithi116 running (114s) 38s ago 114s 17.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1328e0a290ed 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.j smithi007 running (2m) 19s ago 2m 15.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 ad82d47b1236 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.k smithi067 running (2m) 38s ago 2m 19.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b013519ee676 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mds.l smithi116 running (2m) 38s ago 2m 17.1M - 18.2.4-860-g6c6b083f 8a91f241d7d4 8ea9a734e015 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi007 *:9283,8765 running (9m) 19s ago 9m 496M - 18.2.4-860-g6c6b083f 8a91f241d7d4 09f2ff7bc14d 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi067 *:8443,8765 running (7m) 38s ago 7m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 92d147beb16d 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.z smithi116 *:8443,8765 running (7m) 38s ago 7m 439M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1b6276b2a344 2024-09-13T18:16:46.748 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (9m) 19s ago 9m 48.6M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 268cd935a6fd 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi067 running (7m) 38s ago 7m 42.3M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 4ecc450492ff 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi116 running (7m) 38s ago 7m 39.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 53e5bb6fa532 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (7m) 19s ago 7m 47.3M 4273M 18.2.4-860-g6c6b083f 8a91f241d7d4 24ad7daa27eb 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi067 running (6m) 38s ago 6m 49.4M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 c67976e0faff 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi116 running (6m) 38s ago 6m 52.3M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 86548bc515e7 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (5m) 19s ago 5m 52.0M 4273M 18.2.4-860-g6c6b083f 8a91f241d7d4 b14d13794e74 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi067 running (5m) 38s ago 5m 55.3M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 35fac61257ca 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi116 running (5m) 38s ago 5m 54.3M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 4c58609f1bb2 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi007 running (4m) 19s ago 4m 49.4M 4273M 18.2.4-860-g6c6b083f 8a91f241d7d4 eb226e876e2d 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi067 running (4m) 38s ago 4m 47.5M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 f2d1524559d0 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 smithi116 running (3m) 38s ago 3m 46.3M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 8a7987b14294 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 smithi007 running (3m) 19s ago 3m 43.1M 4273M 18.2.4-860-g6c6b083f 8a91f241d7d4 5a7f9ca8e1a2 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 smithi067 running (3m) 38s ago 3m 45.8M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 d18bea409290 2024-09-13T18:16:46.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 smithi116 running (2m) 38s ago 2m 50.5M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 9ce414685bec 2024-09-13T18:16:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f05e40a10b0 msgr2=0x7f05e40a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f05e40a10b0 0x7f05e40a3570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009fc0 tx=0x7f05f0005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06001075f0 msgr2=0x7f060019c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:46.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06001075f0 0x7f060019c970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05ec031500 tx=0x7f05ec003c10 comp rx=0 tx=0).stop 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 shutdown_connections 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f05e40a10b0 0x7f05e40a3570 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0600107fb0 0x7f06001a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06001075f0 0x7f060019c970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 --2- 172.21.15.7:0/1384022247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0600106750 0x7f060019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.747+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 >> 172.21.15.7:0/1384022247 conn(0x7f06000756c0 msgr2=0x7f060010aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.748+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 shutdown_connections 2024-09-13T18:16:46.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:46.748+0000 7f0606000640 1 -- 172.21.15.7:0/1384022247 wait complete. 2024-09-13T18:16:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:46 smithi116 ceph-mon[35109]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:46 smithi067 ceph-mon[35103]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:47.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T18:16:47.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:47 smithi007 ceph-mon[30588]: from='client.25079 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:47.880 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:47.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:47 smithi116 ceph-mon[35109]: from='client.25079 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:47.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:47 smithi067 ceph-mon[35103]: from='client.25079 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:48 smithi116 ceph-mon[35109]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:16:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:48 smithi067 ceph-mon[35103]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:16:49.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:48 smithi007 ceph-mon[30588]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:16:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 -- 172.21.15.7:0/1899332004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 msgr2=0x7f8aec1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 --2- 172.21.15.7:0/1899332004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec1023f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009900 tx=0x7f8adc02a410 comp rx=0 tx=0).stop 2024-09-13T18:16:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 -- 172.21.15.7:0/1899332004 shutdown_connections 2024-09-13T18:16:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 --2- 172.21.15.7:0/1899332004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8aec103bb0 0x7f8aec10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 --2- 172.21.15.7:0/1899332004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8aec1031f0 0x7f8aec103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 --2- 172.21.15.7:0/1899332004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec1023f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:49.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 -- 172.21.15.7:0/1899332004 >> 172.21.15.7:0/1899332004 conn(0x7f8aec0fd7a0 msgr2=0x7f8aec0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 -- 172.21.15.7:0/1899332004 shutdown_connections 2024-09-13T18:16:49.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.841+0000 7f8af0c00640 1 -- 172.21.15.7:0/1899332004 wait complete. 2024-09-13T18:16:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.842+0000 7f8af0c00640 1 Processor -- start 2024-09-13T18:16:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.842+0000 7f8af0c00640 1 -- start start 2024-09-13T18:16:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8af0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8af0c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8aec1031f0 0x7f8aec198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8af0c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8aec103bb0 0x7f8aec19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8af0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec19fad0 con 0x7f8aec101ff0 2024-09-13T18:16:49.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8af0c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec19fc40 con 0x7f8aec1031f0 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8af0c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec19fe00 con 0x7f8aec103bb0 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8ae9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8ae9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44358/0 (socket says 172.21.15.7:44358) 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8ae9e00640 1 -- 172.21.15.7:0/3229124573 learned_addr learned my addr 172.21.15.7:0/3229124573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8aea800640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8aec103bb0 0x7f8aec19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.843+0000 7f8ae9400640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8aec1031f0 0x7f8aec198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae9e00640 1 -- 172.21.15.7:0/3229124573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8aec103bb0 msgr2=0x7f8aec19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae9e00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8aec103bb0 0x7f8aec19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae9e00640 1 -- 172.21.15.7:0/3229124573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8aec1031f0 msgr2=0x7f8aec198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae9e00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8aec1031f0 0x7f8aec198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae9e00640 1 -- 172.21.15.7:0/3229124573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009560 con 0x7f8aec101ff0 2024-09-13T18:16:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae9e00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec198020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0057c0 tx=0x7f8adc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:49.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae2a00640 1 -- 172.21.15.7:0/3229124573 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc004b50 con 0x7f8aec101ff0 2024-09-13T18:16:49.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae2a00640 1 -- 172.21.15.7:0/3229124573 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8adc004cb0 con 0x7f8aec101ff0 2024-09-13T18:16:49.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8ae2a00640 1 -- 172.21.15.7:0/3229124573 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc031ae0 con 0x7f8aec101ff0 2024-09-13T18:16:49.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec1a0080 con 0x7f8aec101ff0 2024-09-13T18:16:49.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.844+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec1a04d0 con 0x7f8aec101ff0 2024-09-13T18:16:49.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.845+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec109490 con 0x7f8aec101ff0 2024-09-13T18:16:49.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.847+0000 7f8ae2a00640 1 -- 172.21.15.7:0/3229124573 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f8adc003c40 con 0x7f8aec101ff0 2024-09-13T18:16:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.848+0000 7f8ae2a00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8ad00a1130 0x7f8ad00a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.849+0000 7f8ae2a00640 1 -- 172.21.15.7:0/3229124573 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8adc0ed700 con 0x7f8aec101ff0 2024-09-13T18:16:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.849+0000 7f8ae9400640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8ad00a1130 0x7f8ad00a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:49.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.849+0000 7f8ae9400640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8ad00a1130 0x7f8ad00a35f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8aec1994f0 tx=0x7f8ad8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:49.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:49.853+0000 7f8ae2a00640 1 -- 172.21.15.7:0/3229124573 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8adc0b6ef0 con 0x7f8aec101ff0 2024-09-13T18:16:50.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.047+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8aec02c480 con 0x7f8ad00a1130 2024-09-13T18:16:50.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.052+0000 7f8ae2a00640 1 -- 172.21.15.7:0/3229124573 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f8aec02c480 con 0x7f8ad00a1130 2024-09-13T18:16:50.055 INFO:teuthology.orchestra.run.smithi007.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T18:16:50.055 INFO:teuthology.orchestra.run.smithi007.stdout:mds.all 12/12 42s ago 2m smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi067=b;smithi067=e;smithi067=h;smithi067=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2024-09-13T18:16:50.055 INFO:teuthology.orchestra.run.smithi007.stdout:mgr 3/3 42s ago 7m smithi007=x;smithi067=y;smithi116=z;count:3 2024-09-13T18:16:50.055 INFO:teuthology.orchestra.run.smithi007.stdout:mon 3/3 42s ago 7m smithi007:172.21.15.7=a;smithi067:172.21.15.67=b;smithi116:172.21.15.116=c;count:3 2024-09-13T18:16:50.056 INFO:teuthology.orchestra.run.smithi007.stdout:osd 12 42s ago - 2024-09-13T18:16:50.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8ad00a1130 msgr2=0x7f8ad00a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:50.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8ad00a1130 0x7f8ad00a35f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8aec1994f0 tx=0x7f8ad8005f90 comp rx=0 tx=0).stop 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 msgr2=0x7f8aec198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec198020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0057c0 tx=0x7f8adc0055a0 comp rx=0 tx=0).stop 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 shutdown_connections 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8ad00a1130 0x7f8ad00a35f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8aec103bb0 0x7f8aec19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8aec1031f0 0x7f8aec198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 --2- 172.21.15.7:0/3229124573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8aec101ff0 0x7f8aec198020 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 >> 172.21.15.7:0/3229124573 conn(0x7f8aec0fd7a0 msgr2=0x7f8aec106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 shutdown_connections 2024-09-13T18:16:50.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:50.055+0000 7f8af0c00640 1 -- 172.21.15.7:0/3229124573 wait complete. 2024-09-13T18:16:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:50 smithi007 ceph-mon[30588]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:50 smithi007 ceph-mon[30588]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:50.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T18:16:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:50 smithi116 ceph-mon[35109]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:50 smithi116 ceph-mon[35109]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:50 smithi067 ceph-mon[35103]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:50 smithi067 ceph-mon[35103]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-13T18:16:51.202 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:52.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:52 smithi007 ceph-mon[30588]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-13T18:16:52.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:52 smithi116 ceph-mon[35109]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-13T18:16:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:52 smithi067 ceph-mon[35103]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-13T18:16:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 -- 172.21.15.7:0/3165583801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 msgr2=0x7f931c103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 --2- 172.21.15.7:0/3165583801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 0x7f931c103690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9308009900 tx=0x7f930802a410 comp rx=0 tx=0).stop 2024-09-13T18:16:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 -- 172.21.15.7:0/3165583801 shutdown_connections 2024-09-13T18:16:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 --2- 172.21.15.7:0/3165583801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c103bd0 0x7f931c10a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 --2- 172.21.15.7:0/3165583801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 0x7f931c103690 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 --2- 172.21.15.7:0/3165583801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c102010 0x7f931c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 -- 172.21.15.7:0/3165583801 >> 172.21.15.7:0/3165583801 conn(0x7f931c0fd7a0 msgr2=0x7f931c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 -- 172.21.15.7:0/3165583801 shutdown_connections 2024-09-13T18:16:53.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.178+0000 7f9322800640 1 -- 172.21.15.7:0/3165583801 wait complete. 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.179+0000 7f9322800640 1 Processor -- start 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.179+0000 7f9322800640 1 -- start start 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f9322800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c102010 0x7f931c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f9322800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 0x7f931c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f9322800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c103bd0 0x7f931c19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f9322800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c19fab0 con 0x7f931c103210 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f9322800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c19fc20 con 0x7f931c103bd0 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f9322800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c19fde0 con 0x7f931c102010 2024-09-13T18:16:53.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c102010 0x7f931c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 0x7f931c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c102010 0x7f931c197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:47892/0 (socket says 172.21.15.7:47892) 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 -- 172.21.15.7:0/3914259425 learned_addr learned my addr 172.21.15.7:0/3914259425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931be00640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c103bd0 0x7f931c19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 -- 172.21.15.7:0/3914259425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c103bd0 msgr2=0x7f931c19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c103bd0 0x7f931c19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 -- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 msgr2=0x7f931c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 0x7f931c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.180+0000 7f931b400640 1 -- 172.21.15.7:0/3914259425 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308009560 con 0x7f931c102010 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.181+0000 7f931b400640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c102010 0x7f931c197fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f930c00e9c0 tx=0x7f930c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.181+0000 7f9313e00640 1 -- 172.21.15.7:0/3914259425 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c009700 con 0x7f931c102010 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.181+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c1a00c0 con 0x7f931c102010 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.181+0000 7f9313e00640 1 -- 172.21.15.7:0/3914259425 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f930c0044e0 con 0x7f931c102010 2024-09-13T18:16:53.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.181+0000 7f9313e00640 1 -- 172.21.15.7:0/3914259425 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c010430 con 0x7f931c102010 2024-09-13T18:16:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.181+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c1a05e0 con 0x7f931c102010 2024-09-13T18:16:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.182+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c109500 con 0x7f931c102010 2024-09-13T18:16:53.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.184+0000 7f9313e00640 1 -- 172.21.15.7:0/3914259425 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f930c003f20 con 0x7f931c102010 2024-09-13T18:16:53.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.186+0000 7f9313e00640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f93000a1130 0x7f93000a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:53.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.186+0000 7f9313e00640 1 -- 172.21.15.7:0/3914259425 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f930c014070 con 0x7f931c102010 2024-09-13T18:16:53.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.186+0000 7f931aa00640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f93000a1130 0x7f93000a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:53.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.186+0000 7f931aa00640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f93000a1130 0x7f93000a35f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f930802aa00 tx=0x7f93080314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:53.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.187+0000 7f9313e00640 1 -- 172.21.15.7:0/3914259425 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f930c096af0 con 0x7f931c102010 2024-09-13T18:16:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.372+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f931c02c450 con 0x7f93000a1130 2024-09-13T18:16:53.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.374+0000 7f9313e00640 1 -- 172.21.15.7:0/3914259425 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f931c02c450 con 0x7f93000a1130 2024-09-13T18:16:53.376 INFO:teuthology.orchestra.run.smithi007.stdout:HOST ADDR LABELS STATUS 2024-09-13T18:16:53.376 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 172.21.15.7 2024-09-13T18:16:53.376 INFO:teuthology.orchestra.run.smithi007.stdout:smithi067 172.21.15.67 2024-09-13T18:16:53.376 INFO:teuthology.orchestra.run.smithi007.stdout:smithi116 172.21.15.116 2024-09-13T18:16:53.376 INFO:teuthology.orchestra.run.smithi007.stdout:3 hosts in cluster 2024-09-13T18:16:53.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f93000a1130 msgr2=0x7f93000a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:53.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f93000a1130 0x7f93000a35f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f930802aa00 tx=0x7f93080314a0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c102010 msgr2=0x7f931c197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c102010 0x7f931c197fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f930c00e9c0 tx=0x7f930c00ee80 comp rx=0 tx=0).stop 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 shutdown_connections 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f93000a1130 0x7f93000a35f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f931c103bd0 0x7f931c19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f931c103210 0x7f931c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 --2- 172.21.15.7:0/3914259425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f931c102010 0x7f931c197fb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 >> 172.21.15.7:0/3914259425 conn(0x7f931c0fd7a0 msgr2=0x7f931c1066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 shutdown_connections 2024-09-13T18:16:53.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:53.376+0000 7f9322800640 1 -- 172.21.15.7:0/3914259425 wait complete. 2024-09-13T18:16:53.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:53 smithi116 ceph-mon[35109]: from='client.25102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:53.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:53 smithi067 ceph-mon[35103]: from='client.25102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:53 smithi007 ceph-mon[30588]: from='client.25102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:54.077 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T18:16:54.396 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:54 smithi007 ceph-mon[30588]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T18:16:54.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:54 smithi116 ceph-mon[35109]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T18:16:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:54 smithi067 ceph-mon[35103]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T18:16:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 -- 172.21.15.7:0/2782279078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c901017f0 msgr2=0x7f9c90108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:56.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/2782279078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c901017f0 0x7f9c90108080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009ca0 tx=0x7f9c8802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 -- 172.21.15.7:0/2782279078 shutdown_connections 2024-09-13T18:16:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/2782279078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c901017f0 0x7f9c90108080 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/2782279078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c90100e30 0x7f9c901012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/2782279078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c900ffc30 0x7f9c90100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 -- 172.21.15.7:0/2782279078 >> 172.21.15.7:0/2782279078 conn(0x7f9c900fb3c0 msgr2=0x7f9c900fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 -- 172.21.15.7:0/2782279078 shutdown_connections 2024-09-13T18:16:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.308+0000 7f9c8fe00640 1 -- 172.21.15.7:0/2782279078 wait complete. 2024-09-13T18:16:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 Processor -- start 2024-09-13T18:16:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 -- start start 2024-09-13T18:16:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c900ffc30 0x7f9c90105b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:56.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c90100e30 0x7f9c901060a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c901017f0 0x7f9c901026c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90102e50 con 0x7f9c90100e30 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90102fc0 con 0x7f9c901017f0 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.309+0000 7f9c8fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90103180 con 0x7f9c900ffc30 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c90100e30 0x7f9c901060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c90100e30 0x7f9c901060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36686/0 (socket says 172.21.15.7:36686) 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 -- 172.21.15.7:0/4036094014 learned_addr learned my addr 172.21.15.7:0/4036094014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:56.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8f400640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c901017f0 0x7f9c901026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8ea00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c900ffc30 0x7f9c90105b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 -- 172.21.15.7:0/4036094014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c900ffc30 msgr2=0x7f9c90105b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c900ffc30 0x7f9c90105b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 -- 172.21.15.7:0/4036094014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c901017f0 msgr2=0x7f9c901026c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c901017f0 0x7f9c901026c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 -- 172.21.15.7:0/4036094014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88009900 con 0x7f9c90100e30 2024-09-13T18:16:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.310+0000 7f9c8e000640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c90100e30 0x7f9c901060a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e9f0 tx=0x7f9c7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.311+0000 7f9c87400640 1 -- 172.21.15.7:0/4036094014 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c009720 con 0x7f9c90100e30 2024-09-13T18:16:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.311+0000 7f9c87400640 1 -- 172.21.15.7:0/4036094014 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c7c00cd80 con 0x7f9c90100e30 2024-09-13T18:16:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.311+0000 7f9c87400640 1 -- 172.21.15.7:0/4036094014 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c010430 con 0x7f9c90100e30 2024-09-13T18:16:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.311+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c901a4290 con 0x7f9c90100e30 2024-09-13T18:16:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.311+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c901a4740 con 0x7f9c90100e30 2024-09-13T18:16:56.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.312+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9010b540 con 0x7f9c90100e30 2024-09-13T18:16:56.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.315+0000 7f9c87400640 1 -- 172.21.15.7:0/4036094014 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f9c7c005000 con 0x7f9c90100e30 2024-09-13T18:16:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.316+0000 7f9c87400640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9c740a1070 0x7f9c740a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:56.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.316+0000 7f9c87400640 1 -- 172.21.15.7:0/4036094014 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9c7c014070 con 0x7f9c90100e30 2024-09-13T18:16:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.316+0000 7f9c8ea00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9c740a1070 0x7f9c740a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:56.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.317+0000 7f9c8ea00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9c740a1070 0x7f9c740a3530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c80005fd0 tx=0x7f9c8000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.318+0000 7f9c87400640 1 -- 172.21.15.7:0/4036094014 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9c7c096590 con 0x7f9c90100e30 2024-09-13T18:16:56.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.509+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c9010b850 con 0x7f9c740a1070 2024-09-13T18:16:56.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.511+0000 7f9c87400640 1 -- 172.21.15.7:0/4036094014 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f9c9010b850 con 0x7f9c740a1070 2024-09-13T18:16:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T18:16:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GE480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-13T18:16:56.514 INFO:teuthology.orchestra.run.smithi007.stdout:smithi067 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440042400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T18:16:56.514 INFO:teuthology.orchestra.run.smithi007.stdout:smithi116 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T18:16:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.514+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9c740a1070 msgr2=0x7f9c740a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.514+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9c740a1070 0x7f9c740a3530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c80005fd0 tx=0x7f9c8000b410 comp rx=0 tx=0).stop 2024-09-13T18:16:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.514+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c90100e30 msgr2=0x7f9c901060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.514+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c90100e30 0x7f9c901060a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e9f0 tx=0x7f9c7c00edf0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 shutdown_connections 2024-09-13T18:16:56.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9c740a1070 0x7f9c740a3530 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c901017f0 0x7f9c901026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c90100e30 0x7f9c901060a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 --2- 172.21.15.7:0/4036094014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c900ffc30 0x7f9c90105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:56.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 >> 172.21.15.7:0/4036094014 conn(0x7f9c900fb3c0 msgr2=0x7f9c90106650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:56.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 shutdown_connections 2024-09-13T18:16:56.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:56.515+0000 7f9c8fe00640 1 -- 172.21.15.7:0/4036094014 wait complete. 2024-09-13T18:16:56.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:56 smithi007 ceph-mon[30588]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:56.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:56 smithi007 ceph-mon[30588]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:56 smithi116 ceph-mon[35109]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:56 smithi116 ceph-mon[35109]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:56 smithi067 ceph-mon[35103]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:16:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:56 smithi067 ceph-mon[35103]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:16:57.186 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:16:57.195 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T18:16:57.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T18:16:57.523 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:16:58.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:58 smithi007 ceph-mon[30588]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:58 smithi116 ceph-mon[35109]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:58 smithi067 ceph-mon[35103]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:16:59.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 -- 172.21.15.7:0/1165104270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc076a50 msgr2=0x7febfc0772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 --2- 172.21.15.7:0/1165104270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc076a50 0x7febfc0772f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febf4009ca0 tx=0x7febf402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 -- 172.21.15.7:0/1165104270 shutdown_connections 2024-09-13T18:16:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 --2- 172.21.15.7:0/1165104270 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc076a50 0x7febfc0772f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 --2- 172.21.15.7:0/1165104270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febfc0760b0 0x7febfc076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 --2- 172.21.15.7:0/1165104270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febfc074e60 0x7febfc075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 -- 172.21.15.7:0/1165104270 >> 172.21.15.7:0/1165104270 conn(0x7febfc0fd7a0 msgr2=0x7febfc0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 -- 172.21.15.7:0/1165104270 shutdown_connections 2024-09-13T18:16:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.614+0000 7fec00a00640 1 -- 172.21.15.7:0/1165104270 wait complete. 2024-09-13T18:16:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.615+0000 7fec00a00640 1 Processor -- start 2024-09-13T18:16:59.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.615+0000 7fec00a00640 1 -- start start 2024-09-13T18:16:59.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7fec00a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc074e60 0x7febfc19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:59.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7fec00a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febfc0760b0 0x7febfc19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7fec00a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febfc076a50 0x7febfc1a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7fec00a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1a3e30 con 0x7febfc074e60 2024-09-13T18:16:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7fec00a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1a3fa0 con 0x7febfc0760b0 2024-09-13T18:16:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7fec00a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1a4160 con 0x7febfc076a50 2024-09-13T18:16:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc074e60 0x7febfc19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:59.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febfc0760b0 0x7febfc19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc074e60 0x7febfc19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36698/0 (socket says 172.21.15.7:36698) 2024-09-13T18:16:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9e00640 1 -- 172.21.15.7:0/2126178796 learned_addr learned my addr 172.21.15.7:0/2126178796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:16:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febfa800640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febfc076a50 0x7febfc1a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:59.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9400640 1 -- 172.21.15.7:0/2126178796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febfc076a50 msgr2=0x7febfc1a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9400640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febfc076a50 0x7febfc1a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9400640 1 -- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc074e60 msgr2=0x7febfc19c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9400640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc074e60 0x7febfc19c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.616+0000 7febf9400640 1 -- 172.21.15.7:0/2126178796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4009900 con 0x7febfc0760b0 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.617+0000 7febf9400640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febfc0760b0 0x7febfc19c870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7febe800e9f0 tx=0x7febe800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.617+0000 7febf2a00640 1 -- 172.21.15.7:0/2126178796 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800ccc0 con 0x7febfc0760b0 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.617+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc1a4440 con 0x7febfc0760b0 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.617+0000 7febf2a00640 1 -- 172.21.15.7:0/2126178796 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febe800ce20 con 0x7febfc0760b0 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.617+0000 7febf2a00640 1 -- 172.21.15.7:0/2126178796 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80187c0 con 0x7febfc0760b0 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.617+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc1a4940 con 0x7febfc0760b0 2024-09-13T18:16:59.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.618+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc10e990 con 0x7febfc0760b0 2024-09-13T18:16:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.620+0000 7febf2a00640 1 -- 172.21.15.7:0/2126178796 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7febe8010430 con 0x7febfc0760b0 2024-09-13T18:16:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.621+0000 7febf2a00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febe00a10b0 0x7febe00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:16:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.622+0000 7febf2a00640 1 -- 172.21.15.7:0/2126178796 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7febe8014070 con 0x7febfc0760b0 2024-09-13T18:16:59.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.622+0000 7febf9e00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febe00a10b0 0x7febe00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:16:59.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.622+0000 7febf9e00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febe00a10b0 0x7febe00a3570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7febec005fd0 tx=0x7febec00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:16:59.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.624+0000 7febf2a00640 1 -- 172.21.15.7:0/2126178796 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7febe8096850 con 0x7febfc0760b0 2024-09-13T18:16:59.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.838+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7febfc111d20 con 0x7febfc0760b0 2024-09-13T18:16:59.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.839+0000 7febf2a00640 1 -- 172.21.15.7:0/2126178796 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2907 (secure 0 0 0) 0x7febe8026b70 con 0x7febfc0760b0 2024-09-13T18:16:59.842 INFO:teuthology.orchestra.run.smithi007.stdout:e26 2024-09-13T18:16:59.842 INFO:teuthology.orchestra.run.smithi007.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:16:59.842 INFO:teuthology.orchestra.run.smithi007.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:legacy client fscid: 1 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:fs_name cephfs 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 26 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-13T18:15:06.002659+0000 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-13T18:15:12.707791+0000 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:tableserver 0 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:root 0 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:session_timeout 300 2024-09-13T18:16:59.843 INFO:teuthology.orchestra.run.smithi007.stdout:session_autoclose 300 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:max_file_size 1099511627776 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:max_xattr_size 65536 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:required_client_features {} 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure 0 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure_osd_epoch 0 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:max_mds 5 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:in 0,1,2,3,4 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:up {0=24581,1=24559,2=24538,3=24533,4=24526} 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:failed 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:damaged 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:stopped 2024-09-13T18:16:59.844 INFO:teuthology.orchestra.run.smithi007.stdout:data_pools [3] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:metadata_pool 2 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:inline_data disabled 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:balancer 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:bal_rank_mask -1 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:standby_count_wanted 0 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b{0:24581} state up:active seq 3 addr [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e{0:24503} state up:standby-replay seq 1 addr [v2:172.21.15.67:6834/833350667,v1:172.21.15.67:6835/833350667] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.i{1:24559} state up:active seq 6 addr [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.j{1:24473} state up:standby-replay seq 1 addr [v2:172.21.15.7:6834/379477361,v1:172.21.15.7:6835/379477361] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c{2:24538} state up:active seq 7 addr [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.l{2:24466} state up:standby-replay seq 1 addr [v2:172.21.15.116:6832/3628414330,v1:172.21.15.116:6833/3628414330] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.h{3:24533} state up:active seq 7 addr [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.845 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.k{3:24461} state up:standby-replay seq 1 addr [v2:172.21.15.67:6832/344470719,v1:172.21.15.67:6833/344470719] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f{4:24526} state up:active seq 8 addr [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a{4:14517} state up:standby-replay seq 1 addr [v2:172.21.15.7:6840/4101588502,v1:172.21.15.7:6841/4101588502] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout:Standby daemons: 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d{-1:14457} state up:standby seq 1 addr [v2:172.21.15.7:6836/903446377,v1:172.21.15.7:6837/903446377] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.846 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.g{-1:14505} state up:standby seq 1 addr [v2:172.21.15.7:6838/3960338026,v1:172.21.15.7:6839/3960338026] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febe00a10b0 msgr2=0x7febe00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febe00a10b0 0x7febe00a3570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7febec005fd0 tx=0x7febec00b480 comp rx=0 tx=0).stop 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febfc0760b0 msgr2=0x7febfc19c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febfc0760b0 0x7febfc19c870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7febe800e9f0 tx=0x7febe800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 shutdown_connections 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7febe00a10b0 0x7febe00a3570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febfc076a50 0x7febfc1a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febfc0760b0 0x7febfc19c870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 --2- 172.21.15.7:0/2126178796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7febfc074e60 0x7febfc19c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:16:59.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 >> 172.21.15.7:0/2126178796 conn(0x7febfc0fd7a0 msgr2=0x7febfc0ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:16:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 shutdown_connections 2024-09-13T18:16:59.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:16:59.841+0000 7fec00a00640 1 -- 172.21.15.7:0/2126178796 wait complete. 2024-09-13T18:17:00.202 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:16:59 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2126178796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:17:00.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:16:59 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2126178796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:17:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:16:59 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2126178796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:17:00.603 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-13T18:17:00.927 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:17:01.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:00 smithi116 ceph-mon[35109]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:01.211 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:00 smithi007 ceph-mon[30588]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:01.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:00 smithi067 ceph-mon[35103]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:02.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.805+0000 7f3197200640 1 -- 172.21.15.7:0/2055555862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198103950 msgr2=0x7f319810a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:02.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.805+0000 7f3197200640 1 --2- 172.21.15.7:0/2055555862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198103950 0x7f319810a270 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3190009860 tx=0x7f319002a340 comp rx=0 tx=0).stop 2024-09-13T18:17:02.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.805+0000 7f3197200640 1 -- 172.21.15.7:0/2055555862 shutdown_connections 2024-09-13T18:17:02.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.805+0000 7f3197200640 1 --2- 172.21.15.7:0/2055555862 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198103950 0x7f319810a270 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:02.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.805+0000 7f3197200640 1 --2- 172.21.15.7:0/2055555862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3198102f90 0x7f3198103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:02.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.805+0000 7f3197200640 1 --2- 172.21.15.7:0/2055555862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3198101e30 0x7f3198102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:02.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.805+0000 7f3197200640 1 -- 172.21.15.7:0/2055555862 >> 172.21.15.7:0/2055555862 conn(0x7f31980fd5e0 msgr2=0x7f31980ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:02.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.806+0000 7f3197200640 1 -- 172.21.15.7:0/2055555862 shutdown_connections 2024-09-13T18:17:02.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.806+0000 7f3197200640 1 -- 172.21.15.7:0/2055555862 wait complete. 2024-09-13T18:17:02.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.806+0000 7f3197200640 1 Processor -- start 2024-09-13T18:17:02.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3197200640 1 -- start start 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3197200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198101e30 0x7f3198197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3197200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3198102f90 0x7f31981982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3197200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3198103950 0x7f319819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3197200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319819f860 con 0x7f3198101e30 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3197200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319819f9d0 con 0x7f3198102f90 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3197200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319819fb90 con 0x7f3198103950 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3195e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198101e30 0x7f3198197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3195e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198101e30 0x7f3198197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36726/0 (socket says 172.21.15.7:36726) 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3195e00640 1 -- 172.21.15.7:0/3903963677 learned_addr learned my addr 172.21.15.7:0/3903963677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f318d400640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3198102f90 0x7f31981982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.807+0000 7f3196800640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3198103950 0x7f319819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:02.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3195e00640 1 -- 172.21.15.7:0/3903963677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3198103950 msgr2=0x7f319819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3195e00640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3198103950 0x7f319819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3195e00640 1 -- 172.21.15.7:0/3903963677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3198102f90 msgr2=0x7f31981982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3195e00640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3198102f90 0x7f31981982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3195e00640 1 -- 172.21.15.7:0/3903963677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009490 con 0x7f3198101e30 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3196800640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3198103950 0x7f319819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3195e00640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198101e30 0x7f3198197d60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f318800efb0 tx=0x7f318800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f318f400640 1 -- 172.21.15.7:0/3903963677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800b570 con 0x7f3198101e30 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f318f400640 1 -- 172.21.15.7:0/3903963677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f318800bb90 con 0x7f3198101e30 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319819fe70 con 0x7f3198101e30 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.808+0000 7f318f400640 1 -- 172.21.15.7:0/3903963677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188016c70 con 0x7f3198101e30 2024-09-13T18:17:02.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.809+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31981a02e0 con 0x7f3198101e30 2024-09-13T18:17:02.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.810+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3198109270 con 0x7f3198101e30 2024-09-13T18:17:02.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.811+0000 7f318f400640 1 -- 172.21.15.7:0/3903963677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f318800a040 con 0x7f3198101e30 2024-09-13T18:17:02.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.813+0000 7f318f400640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f317c0a1120 0x7f317c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:02.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.813+0000 7f318f400640 1 -- 172.21.15.7:0/3903963677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f31880cc810 con 0x7f3198101e30 2024-09-13T18:17:02.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.813+0000 7f318d400640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f317c0a1120 0x7f317c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:02.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.814+0000 7f318d400640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f317c0a1120 0x7f317c0a35e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3198199280 tx=0x7f3180005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:02.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.816+0000 7f318f400640 1 -- 172.21.15.7:0/3903963677 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3188096000 con 0x7f3198101e30 2024-09-13T18:17:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:02 smithi116 ceph-mon[35109]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:02 smithi067 ceph-mon[35103]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.998+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f319802c4e0 con 0x7f3198101e30 2024-09-13T18:17:03.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:02 smithi007 ceph-mon[30588]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:03.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:02.999+0000 7f318f400640 1 -- 172.21.15.7:0/3903963677 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5232 (secure 0 0 0) 0x7f3188099620 con 0x7f3198101e30 2024-09-13T18:17:03.003 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 88 2024-09-13T18:17:03.003 INFO:teuthology.orchestra.run.smithi007.stdout:fsid d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:17:03.003 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-13T18:07:06.965649+0000 2024-09-13T18:17:03.003 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-13T18:16:10.029936+0000 2024-09-13T18:17:03.003 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T18:17:03.003 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 26 2024-09-13T18:17:03.003 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client luminous 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release reef 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 12 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6802/1444921762,v1:172.21.15.7:6803/1444921762] [v2:172.21.15.7:6804/1444921762,v1:172.21.15.7:6805/1444921762] exists,up af9e0446-69fd-4727-87e3-8843be69e76e 2024-09-13T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6800/1600577441,v1:172.21.15.67:6801/1600577441] [v2:172.21.15.67:6802/1600577441,v1:172.21.15.67:6803/1600577441] exists,up b4126006-2c69-4d91-bd88-868de39d0cb4 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/3932152081,v1:172.21.15.116:6801/3932152081] [v2:172.21.15.116:6802/3932152081,v1:172.21.15.116:6803/3932152081] exists,up 53b66ec9-242b-4ec9-80b5-6abf872a748f 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6810/1622258084,v1:172.21.15.7:6811/1622258084] [v2:172.21.15.7:6812/1622258084,v1:172.21.15.7:6813/1622258084] exists,up de4ca10d-cfea-4ff0-b71d-dca462cca1e2 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6808/570234379,v1:172.21.15.67:6809/570234379] [v2:172.21.15.67:6810/570234379,v1:172.21.15.67:6811/570234379] exists,up 9537f823-5479-4ebc-8d59-2b4680603d49 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/1272520856,v1:172.21.15.116:6809/1272520856] [v2:172.21.15.116:6810/1272520856,v1:172.21.15.116:6811/1272520856] exists,up 5ac8d45a-bdc2-4afb-800f-0137f53371d3 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 47 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6818/967037099,v1:172.21.15.7:6819/967037099] [v2:172.21.15.7:6820/967037099,v1:172.21.15.7:6821/967037099] exists,up d9b1e65f-df07-4b3a-a539-d046476a6924 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6816/4066195090,v1:172.21.15.67:6817/4066195090] [v2:172.21.15.67:6818/4066195090,v1:172.21.15.67:6819/4066195090] exists,up a3507f69-414b-44ad-ba04-76cc2a294486 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/85007124,v1:172.21.15.116:6817/85007124] [v2:172.21.15.116:6818/85007124,v1:172.21.15.116:6819/85007124] exists,up 1d972ef6-53bc-46f7-830d-eee3d6b87547 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6826/2537283667,v1:172.21.15.7:6827/2537283667] [v2:172.21.15.7:6828/2537283667,v1:172.21.15.7:6829/2537283667] exists,up 612f22e2-8306-4302-ae63-359543549743 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 up in weight 1 up_from 73 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6824/782995716,v1:172.21.15.67:6825/782995716] [v2:172.21.15.67:6826/782995716,v1:172.21.15.67:6827/782995716] exists,up 44734350-17d9-43ed-9a32-6d52226d6a33 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6824/3892290282,v1:172.21.15.116:6825/3892290282] [v2:172.21.15.116:6826/3892290282,v1:172.21.15.116:6827/3892290282] exists,up 0e90836c-ffe2-434a-b93c-520c3ef9652b 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.8 [2,11] 2024-09-13T18:17:03.005 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.10 [2,4] 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.1d [8,11] 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.2 [3,9] 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.6 [4,6] 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.13 [4,9] 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.14 [4,7] 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.21 [5,9] 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1716014046 expires 2024-09-14T18:08:08.423245+0000 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3391098565 expires 2024-09-14T18:08:08.423245+0000 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1721886388 expires 2024-09-14T18:08:08.423245+0000 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2474200435 expires 2024-09-14T18:08:08.423245+0000 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2450025711 expires 2024-09-14T18:07:40.349994+0000 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3391098565 expires 2024-09-14T18:08:08.423245+0000 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/3768640508 expires 2024-09-14T18:07:40.349994+0000 2024-09-13T18:17:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/3365645542 expires 2024-09-14T18:07:40.349994+0000 2024-09-13T18:17:03.007 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/568921109 expires 2024-09-14T18:07:40.349994+0000 2024-09-13T18:17:03.007 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/568921109 expires 2024-09-14T18:07:40.349994+0000 2024-09-13T18:17:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f317c0a1120 msgr2=0x7f317c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f317c0a1120 0x7f317c0a35e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3198199280 tx=0x7f3180005f90 comp rx=0 tx=0).stop 2024-09-13T18:17:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198101e30 msgr2=0x7f3198197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198101e30 0x7f3198197d60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f318800efb0 tx=0x7f318800c800 comp rx=0 tx=0).stop 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 shutdown_connections 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f317c0a1120 0x7f317c0a35e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3198103950 0x7f319819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3198102f90 0x7f31981982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 --2- 172.21.15.7:0/3903963677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198101e30 0x7f3198197d60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 >> 172.21.15.7:0/3903963677 conn(0x7f31980fd5e0 msgr2=0x7f3198106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 shutdown_connections 2024-09-13T18:17:03.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:03.002+0000 7f3197200640 1 -- 172.21.15.7:0/3903963677 wait complete. 2024-09-13T18:17:03.878 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-13T18:17:03.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:17:03.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:03 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3903963677' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T18:17:04.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:03 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3903963677' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T18:17:04.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 -- 172.21.15.7:0/606686808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03781031d0 msgr2=0x7f0378103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 --2- 172.21.15.7:0/606686808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03781031d0 0x7f0378103650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 -- 172.21.15.7:0/606686808 shutdown_connections 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 --2- 172.21.15.7:0/606686808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0378103b90 0x7f037810a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 --2- 172.21.15.7:0/606686808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03781031d0 0x7f0378103650 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 --2- 172.21.15.7:0/606686808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0378101fe0 0x7f03781023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 -- 172.21.15.7:0/606686808 >> 172.21.15.7:0/606686808 conn(0x7f03780fd760 msgr2=0x7f03780ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 -- 172.21.15.7:0/606686808 shutdown_connections 2024-09-13T18:17:04.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.048+0000 7f037fc00640 1 -- 172.21.15.7:0/606686808 wait complete. 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.049+0000 7f037fc00640 1 Processor -- start 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.049+0000 7f037fc00640 1 -- start start 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037fc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0378101fe0 0x7f0378197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037fc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03781031d0 0x7f03781984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037fc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0378103b90 0x7f037819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037fc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037819fa70 con 0x7f0378101fe0 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037fc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037819fbe0 con 0x7f03781031d0 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037fc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037819fda0 con 0x7f0378103b90 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0378101fe0 0x7f0378197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0378101fe0 0x7f0378197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55820/0 (socket says 172.21.15.7:55820) 2024-09-13T18:17:04.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 -- 172.21.15.7:0/2447701621 learned_addr learned my addr 172.21.15.7:0/2447701621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f0377e00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03781031d0 0x7f03781984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037dc00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0378103b90 0x7f037819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 -- 172.21.15.7:0/2447701621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0378103b90 msgr2=0x7f037819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0378103b90 0x7f037819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 -- 172.21.15.7:0/2447701621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03781031d0 msgr2=0x7f03781984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03781031d0 0x7f03781984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f037d200640 1 -- 172.21.15.7:0/2447701621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364009560 con 0x7f0378101fe0 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.050+0000 7f0377e00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03781031d0 0x7f03781984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.051+0000 7f037d200640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0378101fe0 0x7f0378197f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f036c00d950 tx=0x7f036c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.051+0000 7f0375600640 1 -- 172.21.15.7:0/2447701621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c009c30 con 0x7f0378101fe0 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.051+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03781a0080 con 0x7f0378101fe0 2024-09-13T18:17:04.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.051+0000 7f0375600640 1 -- 172.21.15.7:0/2447701621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f036c009d90 con 0x7f0378101fe0 2024-09-13T18:17:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.051+0000 7f0375600640 1 -- 172.21.15.7:0/2447701621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00f7e0 con 0x7f0378101fe0 2024-09-13T18:17:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.051+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03781a0560 con 0x7f0378101fe0 2024-09-13T18:17:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.052+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0378109490 con 0x7f0378101fe0 2024-09-13T18:17:04.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.054+0000 7f0375600640 1 -- 172.21.15.7:0/2447701621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f036c010460 con 0x7f0378101fe0 2024-09-13T18:17:04.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.055+0000 7f0375600640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03600a1090 0x7f03600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.055+0000 7f0375600640 1 -- 172.21.15.7:0/2447701621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f036c0ccb90 con 0x7f0378101fe0 2024-09-13T18:17:04.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.055+0000 7f0377e00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03600a1090 0x7f03600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.056+0000 7f0377e00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03600a1090 0x7f03600a3550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0364000c00 tx=0x7f0364005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:04.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.059+0000 7f0375600640 1 -- 172.21.15.7:0/2447701621 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f036c0962d0 con 0x7f0378101fe0 2024-09-13T18:17:04.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:03 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3903963677' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T18:17:04.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.239+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f037810d8a0 con 0x7f0378101fe0 2024-09-13T18:17:04.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.241+0000 7f0375600640 1 -- 172.21.15.7:0/2447701621 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7f036c0998f0 con 0x7f0378101fe0 2024-09-13T18:17:04.244 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:17:04.245 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:17:04.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03600a1090 msgr2=0x7f03600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03600a1090 0x7f03600a3550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0364000c00 tx=0x7f0364005760 comp rx=0 tx=0).stop 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0378101fe0 msgr2=0x7f0378197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0378101fe0 0x7f0378197f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f036c00d950 tx=0x7f036c00de10 comp rx=0 tx=0).stop 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 shutdown_connections 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03600a1090 0x7f03600a3550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0378103b90 0x7f037819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03781031d0 0x7f03781984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 --2- 172.21.15.7:0/2447701621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0378101fe0 0x7f0378197f80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 >> 172.21.15.7:0/2447701621 conn(0x7f03780fd760 msgr2=0x7f0378106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 shutdown_connections 2024-09-13T18:17:04.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.243+0000 7f037fc00640 1 -- 172.21.15.7:0/2447701621 wait complete. 2024-09-13T18:17:04.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:15:04.217247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:15:05.500183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:17:04.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:17:04.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 -- 172.21.15.7:0/3443635077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4101fa0 msgr2=0x7f7ba41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 --2- 172.21.15.7:0/3443635077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4101fa0 0x7f7ba41023a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009900 tx=0x7f7b9402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 -- 172.21.15.7:0/3443635077 shutdown_connections 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 --2- 172.21.15.7:0/3443635077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ba4103b50 0x7f7ba410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 --2- 172.21.15.7:0/3443635077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ba4103190 0x7f7ba4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 --2- 172.21.15.7:0/3443635077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4101fa0 0x7f7ba41023a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 -- 172.21.15.7:0/3443635077 >> 172.21.15.7:0/3443635077 conn(0x7f7ba40fd720 msgr2=0x7f7ba40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 -- 172.21.15.7:0/3443635077 shutdown_connections 2024-09-13T18:17:04.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.421+0000 7f7ba9600640 1 -- 172.21.15.7:0/3443635077 wait complete. 2024-09-13T18:17:04.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.422+0000 7f7ba9600640 1 Processor -- start 2024-09-13T18:17:04.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.422+0000 7f7ba9600640 1 -- start start 2024-09-13T18:17:04.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.422+0000 7f7ba9600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ba4101fa0 0x7f7ba4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4103190 0x7f7ba4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba9600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ba4103b50 0x7f7ba419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba9600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba419fa10 con 0x7f7ba4103190 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba9600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba419fb80 con 0x7f7ba4103b50 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba9600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba419fd40 con 0x7f7ba4101fa0 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4103190 0x7f7ba4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4103190 0x7f7ba4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55836/0 (socket says 172.21.15.7:55836) 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 -- 172.21.15.7:0/1838851099 learned_addr learned my addr 172.21.15.7:0/1838851099 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba2a00640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ba4101fa0 0x7f7ba4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba3400640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ba4103b50 0x7f7ba419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 -- 172.21.15.7:0/1838851099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ba4101fa0 msgr2=0x7f7ba4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ba4101fa0 0x7f7ba4197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 -- 172.21.15.7:0/1838851099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ba4103b50 msgr2=0x7f7ba419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ba4103b50 0x7f7ba419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7b9be00640 1 -- 172.21.15.7:0/1838851099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94009560 con 0x7f7ba4103190 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.423+0000 7f7ba2a00640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ba4101fa0 0x7f7ba4197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.424+0000 7f7b9be00640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4103190 0x7f7ba4198460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00e9f0 tx=0x7f7b8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.424+0000 7f7b9b400640 1 -- 172.21.15.7:0/1838851099 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c009700 con 0x7f7ba4103190 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.424+0000 7f7b9b400640 1 -- 172.21.15.7:0/1838851099 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b8c00cd80 con 0x7f7ba4103190 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.424+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba419ffc0 con 0x7f7ba4103190 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.424+0000 7f7b9b400640 1 -- 172.21.15.7:0/1838851099 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c018860 con 0x7f7ba4103190 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.424+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba41a04a0 con 0x7f7ba4103190 2024-09-13T18:17:04.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.425+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba4109400 con 0x7f7ba4103190 2024-09-13T18:17:04.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.427+0000 7f7b9b400640 1 -- 172.21.15.7:0/1838851099 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f7b8c0189c0 con 0x7f7ba4103190 2024-09-13T18:17:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.429+0000 7f7b9b400640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7b880a1090 0x7f7b880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.429+0000 7f7b9b400640 1 -- 172.21.15.7:0/1838851099 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7b8c014070 con 0x7f7ba4103190 2024-09-13T18:17:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.429+0000 7f7ba2a00640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7b880a1090 0x7f7b880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.430+0000 7f7ba2a00640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7b880a1090 0x7f7b880a3550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005ab0 tx=0x7f7b940314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:04.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.432+0000 7f7b9b400640 1 -- 172.21.15.7:0/1838851099 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7b8c052e20 con 0x7f7ba4103190 2024-09-13T18:17:04.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.613+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ba402c410 con 0x7f7ba4103190 2024-09-13T18:17:04.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.614+0000 7f7b9b400640 1 -- 172.21.15.7:0/1838851099 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b8c0963d0 con 0x7f7ba4103190 2024-09-13T18:17:04.617 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:17:04.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7b880a1090 msgr2=0x7f7b880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7b880a1090 0x7f7b880a3550 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005ab0 tx=0x7f7b940314a0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4103190 msgr2=0x7f7ba4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4103190 0x7f7ba4198460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00e9f0 tx=0x7f7b8c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 shutdown_connections 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7b880a1090 0x7f7b880a3550 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ba4103b50 0x7f7ba419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ba4103190 0x7f7ba4198460 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 --2- 172.21.15.7:0/1838851099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ba4101fa0 0x7f7ba4197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 >> 172.21.15.7:0/1838851099 conn(0x7f7ba40fd720 msgr2=0x7f7ba41065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 shutdown_connections 2024-09-13T18:17:04.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.616+0000 7f7ba9600640 1 -- 172.21.15.7:0/1838851099 wait complete. 2024-09-13T18:17:04.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:17:04.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 -- 172.21.15.7:0/249299856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 msgr2=0x7f10581081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 --2- 172.21.15.7:0/249299856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f10581081d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1050009ca0 tx=0x7f105002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 -- 172.21.15.7:0/249299856 shutdown_connections 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 --2- 172.21.15.7:0/249299856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f10581081d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 --2- 172.21.15.7:0/249299856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1058100f80 0x7f1058101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 --2- 172.21.15.7:0/249299856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10580ffd90 0x7f1058100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 -- 172.21.15.7:0/249299856 >> 172.21.15.7:0/249299856 conn(0x7f10580fb510 msgr2=0x7f10580fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 -- 172.21.15.7:0/249299856 shutdown_connections 2024-09-13T18:17:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.794+0000 7f105ce00640 1 -- 172.21.15.7:0/249299856 wait complete. 2024-09-13T18:17:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 Processor -- start 2024-09-13T18:17:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 -- start start 2024-09-13T18:17:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10580ffd90 0x7f1058197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1058100f80 0x7f10581984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f105819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105819fa50 con 0x7f1058101940 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105819fbc0 con 0x7f10580ffd90 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.795+0000 7f105ce00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105819fd80 con 0x7f1058100f80 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f105819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f105819f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55850/0 (socket says 172.21.15.7:55850) 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 -- 172.21.15.7:0/987847137 learned_addr learned my addr 172.21.15.7:0/987847137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1055e00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10580ffd90 0x7f1058197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f104d400640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1058100f80 0x7f10581984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 -- 172.21.15.7:0/987847137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1058100f80 msgr2=0x7f10581984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1058100f80 0x7f10581984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 -- 172.21.15.7:0/987847137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10580ffd90 msgr2=0x7f1058197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10580ffd90 0x7f1058197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 -- 172.21.15.7:0/987847137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050009900 con 0x7f1058101940 2024-09-13T18:17:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.796+0000 7f1056800640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f105819f510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f105002ade0 tx=0x7f1050032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.797+0000 7f104f400640 1 -- 172.21.15.7:0/987847137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050003b70 con 0x7f1058101940 2024-09-13T18:17:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.797+0000 7f104f400640 1 -- 172.21.15.7:0/987847137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1050040070 con 0x7f1058101940 2024-09-13T18:17:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.797+0000 7f104f400640 1 -- 172.21.15.7:0/987847137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10500043c0 con 0x7f1058101940 2024-09-13T18:17:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.797+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10581a0000 con 0x7f1058101940 2024-09-13T18:17:04.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.797+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10581a04c0 con 0x7f1058101940 2024-09-13T18:17:04.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.798+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105810b680 con 0x7f1058101940 2024-09-13T18:17:04.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.800+0000 7f104f400640 1 -- 172.21.15.7:0/987847137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f1050042030 con 0x7f1058101940 2024-09-13T18:17:04.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.801+0000 7f104f400640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f103c0a1110 0x7f103c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:04.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.801+0000 7f104f400640 1 -- 172.21.15.7:0/987847137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f10500edde0 con 0x7f1058101940 2024-09-13T18:17:04.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.801+0000 7f1055e00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f103c0a1110 0x7f103c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:04.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.802+0000 7f1055e00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f103c0a1110 0x7f103c0a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1058100de0 tx=0x7f1048005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:04.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.804+0000 7f104f400640 1 -- 172.21.15.7:0/987847137 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f10500b7730 con 0x7f1058101940 2024-09-13T18:17:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.984+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10581a09c0 con 0x7f1058101940 2024-09-13T18:17:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.985+0000 7f104f400640 1 -- 172.21.15.7:0/987847137 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10500bad50 con 0x7f1058101940 2024-09-13T18:17:04.988 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T18:17:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f103c0a1110 msgr2=0x7f103c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f103c0a1110 0x7f103c0a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1058100de0 tx=0x7f1048005f90 comp rx=0 tx=0).stop 2024-09-13T18:17:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 msgr2=0x7f105819f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f105819f510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f105002ade0 tx=0x7f1050032f20 comp rx=0 tx=0).stop 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 shutdown_connections 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f103c0a1110 0x7f103c0a35d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1058101940 0x7f105819f510 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1058100f80 0x7f10581984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 --2- 172.21.15.7:0/987847137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10580ffd90 0x7f1058197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 >> 172.21.15.7:0/987847137 conn(0x7f10580fb510 msgr2=0x7f1058106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 shutdown_connections 2024-09-13T18:17:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:04.987+0000 7f105ce00640 1 -- 172.21.15.7:0/987847137 wait complete. 2024-09-13T18:17:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:04 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2447701621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:04 smithi067 ceph-mon[35103]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:04 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1838851099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:17:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:04 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2447701621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:04 smithi007 ceph-mon[30588]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:05.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:04 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1838851099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:17:05.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:17:05.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 -- 172.21.15.7:0/884898191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0103190 msgr2=0x7f4cf0103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/884898191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0103190 0x7f4cf0103610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009900 tx=0x7f4cdc02a410 comp rx=0 tx=0).stop 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 -- 172.21.15.7:0/884898191 shutdown_connections 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/884898191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cf0103b50 0x7f4cf010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/884898191 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0103190 0x7f4cf0103610 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/884898191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf0101fa0 0x7f4cf01023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 -- 172.21.15.7:0/884898191 >> 172.21.15.7:0/884898191 conn(0x7f4cf00fd720 msgr2=0x7f4cf00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 -- 172.21.15.7:0/884898191 shutdown_connections 2024-09-13T18:17:05.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.164+0000 7f4cf7c00640 1 -- 172.21.15.7:0/884898191 wait complete. 2024-09-13T18:17:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 Processor -- start 2024-09-13T18:17:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 -- start start 2024-09-13T18:17:05.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0101fa0 0x7f4cf0197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf0103190 0x7f4cf01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cf0103b50 0x7f4cf019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf019fa80 con 0x7f4cf0101fa0 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf019fbf0 con 0x7f4cf0103190 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.165+0000 7f4cf7c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf019fdb0 con 0x7f4cf0103b50 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0101fa0 0x7f4cf0197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0101fa0 0x7f4cf0197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55876/0 (socket says 172.21.15.7:55876) 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 -- 172.21.15.7:0/1482620161 learned_addr learned my addr 172.21.15.7:0/1482620161 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cefe00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf0103190 0x7f4cf01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5c00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cf0103b50 0x7f4cf019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 -- 172.21.15.7:0/1482620161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cf0103b50 msgr2=0x7f4cf019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cf0103b50 0x7f4cf019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 -- 172.21.15.7:0/1482620161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf0103190 msgr2=0x7f4cf01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf0103190 0x7f4cf01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 -- 172.21.15.7:0/1482620161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc009560 con 0x7f4cf0101fa0 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cefe00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf0103190 0x7f4cf01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.166+0000 7f4cf5200640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0101fa0 0x7f4cf0197f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400e9c0 tx=0x7f4ce400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.167+0000 7f4ced600640 1 -- 172.21.15.7:0/1482620161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4009700 con 0x7f4cf0101fa0 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.167+0000 7f4ced600640 1 -- 172.21.15.7:0/1482620161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ce40044e0 con 0x7f4cf0101fa0 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.167+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf01a0090 con 0x7f4cf0101fa0 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.167+0000 7f4ced600640 1 -- 172.21.15.7:0/1482620161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4010430 con 0x7f4cf0101fa0 2024-09-13T18:17:05.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.167+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf01a0570 con 0x7f4cf0101fa0 2024-09-13T18:17:05.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.168+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf0109400 con 0x7f4cf0101fa0 2024-09-13T18:17:05.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.170+0000 7f4ced600640 1 -- 172.21.15.7:0/1482620161 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f4ce4003f60 con 0x7f4cf0101fa0 2024-09-13T18:17:05.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.171+0000 7f4ced600640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4cd80a1090 0x7f4cd80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.171+0000 7f4ced600640 1 -- 172.21.15.7:0/1482620161 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4ce4014070 con 0x7f4cf0101fa0 2024-09-13T18:17:05.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.171+0000 7f4cefe00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4cd80a1090 0x7f4cd80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.172+0000 7f4cefe00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4cd80a1090 0x7f4cd80a3550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000c00 tx=0x7f4cdc005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:05.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.174+0000 7f4ced600640 1 -- 172.21.15.7:0/1482620161 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ce40d2020 con 0x7f4cf0101fa0 2024-09-13T18:17:05.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:04 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2447701621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:05.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:04 smithi116 ceph-mon[35109]: pgmap v346: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:05.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:04 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1838851099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:17:05.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.353+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cf010d8b0 con 0x7f4cf0101fa0 2024-09-13T18:17:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.353+0000 7f4ced600640 1 -- 172.21.15.7:0/1482620161 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ce4096610 con 0x7f4cf0101fa0 2024-09-13T18:17:05.357 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T18:17:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.355+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4cd80a1090 msgr2=0x7f4cd80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.355+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4cd80a1090 0x7f4cd80a3550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000c00 tx=0x7f4cdc005760 comp rx=0 tx=0).stop 2024-09-13T18:17:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0101fa0 msgr2=0x7f4cf0197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0101fa0 0x7f4cf0197f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400e9c0 tx=0x7f4ce400ee80 comp rx=0 tx=0).stop 2024-09-13T18:17:05.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 shutdown_connections 2024-09-13T18:17:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4cd80a1090 0x7f4cd80a3550 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4cf0103b50 0x7f4cf019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4cf0103190 0x7f4cf01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 --2- 172.21.15.7:0/1482620161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cf0101fa0 0x7f4cf0197f90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 >> 172.21.15.7:0/1482620161 conn(0x7f4cf00fd720 msgr2=0x7f4cf01065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 shutdown_connections 2024-09-13T18:17:05.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.356+0000 7f4cf7c00640 1 -- 172.21.15.7:0/1482620161 wait complete. 2024-09-13T18:17:05.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 -- 172.21.15.7:0/4071678907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf201031d0 msgr2=0x7fdf20103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 --2- 172.21.15.7:0/4071678907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf201031d0 0x7fdf20103650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009900 tx=0x7fdf0c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 -- 172.21.15.7:0/4071678907 shutdown_connections 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 --2- 172.21.15.7:0/4071678907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf20103b90 0x7fdf2010a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 --2- 172.21.15.7:0/4071678907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf201031d0 0x7fdf20103650 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 --2- 172.21.15.7:0/4071678907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf20101fe0 0x7fdf201023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 -- 172.21.15.7:0/4071678907 >> 172.21.15.7:0/4071678907 conn(0x7fdf200fd760 msgr2=0x7fdf200ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:05.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 -- 172.21.15.7:0/4071678907 shutdown_connections 2024-09-13T18:17:05.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.528+0000 7fdf28400640 1 -- 172.21.15.7:0/4071678907 wait complete. 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.529+0000 7fdf28400640 1 Processor -- start 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.529+0000 7fdf28400640 1 -- start start 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf28400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf20101fe0 0x7fdf20197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf28400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf201031d0 0x7fdf201984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf28400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf20103b90 0x7fdf2019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf28400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2019faa0 con 0x7fdf20101fe0 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf28400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2019fc10 con 0x7fdf20103b90 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf28400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2019fdd0 con 0x7fdf201031d0 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf20101fe0 0x7fdf20197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf20101fe0 0x7fdf20197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55896/0 (socket says 172.21.15.7:55896) 2024-09-13T18:17:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 -- 172.21.15.7:0/2333879202 learned_addr learned my addr 172.21.15.7:0/2333879202 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25000640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf201031d0 0x7fdf201984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf26400640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf20103b90 0x7fdf2019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 -- 172.21.15.7:0/2333879202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf201031d0 msgr2=0x7fdf201984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf201031d0 0x7fdf201984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 -- 172.21.15.7:0/2333879202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf20103b90 msgr2=0x7fdf2019f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf20103b90 0x7fdf2019f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25a00640 1 -- 172.21.15.7:0/2333879202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18009840 con 0x7fdf20101fe0 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.530+0000 7fdf25000640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf201031d0 0x7fdf201984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.531+0000 7fdf25a00640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf20101fe0 0x7fdf20197fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e9c0 tx=0x7fdf1400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.531+0000 7fdf1e000640 1 -- 172.21.15.7:0/2333879202 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14009700 con 0x7fdf20101fe0 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.531+0000 7fdf1e000640 1 -- 172.21.15.7:0/2333879202 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf140044e0 con 0x7fdf20101fe0 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.531+0000 7fdf1e000640 1 -- 172.21.15.7:0/2333879202 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14010430 con 0x7fdf20101fe0 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.531+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c009560 con 0x7fdf20101fe0 2024-09-13T18:17:05.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.531+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf201a03b0 con 0x7fdf20101fe0 2024-09-13T18:17:05.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.532+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf20109460 con 0x7fdf20101fe0 2024-09-13T18:17:05.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.534+0000 7fdf1e000640 1 -- 172.21.15.7:0/2333879202 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fdf14003f60 con 0x7fdf20101fe0 2024-09-13T18:17:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.536+0000 7fdf1e000640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdf080a1090 0x7fdf080a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.536+0000 7fdf1e000640 1 -- 172.21.15.7:0/2333879202 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdf14014070 con 0x7fdf20101fe0 2024-09-13T18:17:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.537+0000 7fdf25000640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdf080a1090 0x7fdf080a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.537+0000 7fdf25000640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdf080a1090 0x7fdf080a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:05.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.540+0000 7fdf1e000640 1 -- 172.21.15.7:0/2333879202 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdf140d2020 con 0x7fdf20101fe0 2024-09-13T18:17:05.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.759+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf2010d8a0 con 0x7fdf20101fe0 2024-09-13T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.760+0000 7fdf1e000640 1 -- 172.21.15.7:0/2333879202 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10889 (secure 0 0 0) 0x7fdf14096610 con 0x7fdf20101fe0 2024-09-13T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:15:12.707791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:17:05.764 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T18:17:05.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdf080a1090 msgr2=0x7fdf080a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdf080a1090 0x7fdf080a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c000c00 tx=0x7fdf0c005760 comp rx=0 tx=0).stop 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf20101fe0 msgr2=0x7fdf20197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf20101fe0 0x7fdf20197fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400e9c0 tx=0x7fdf1400ee80 comp rx=0 tx=0).stop 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 shutdown_connections 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdf080a1090 0x7fdf080a3550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf20103b90 0x7fdf2019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf201031d0 0x7fdf201984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 --2- 172.21.15.7:0/2333879202 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf20101fe0 0x7fdf20197fb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 >> 172.21.15.7:0/2333879202 conn(0x7fdf200fd760 msgr2=0x7fdf20106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 shutdown_connections 2024-09-13T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.762+0000 7fdf28400640 1 -- 172.21.15.7:0/2333879202 wait complete. 2024-09-13T18:17:05.783 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:17:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.937+0000 7f8c8ea00640 1 -- 172.21.15.7:0/356650585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c88101fe0 msgr2=0x7f8c881023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.937+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/356650585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c88101fe0 0x7f8c881023e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009900 tx=0x7f8c7802a410 comp rx=0 tx=0).stop 2024-09-13T18:17:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.937+0000 7f8c8ea00640 1 -- 172.21.15.7:0/356650585 shutdown_connections 2024-09-13T18:17:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.937+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/356650585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c88103b90 0x7f8c8810a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.937+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/356650585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c881031d0 0x7f8c88103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.937+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/356650585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c88101fe0 0x7f8c881023e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.937+0000 7f8c8ea00640 1 -- 172.21.15.7:0/356650585 >> 172.21.15.7:0/356650585 conn(0x7f8c880fd760 msgr2=0x7f8c880ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.938+0000 7f8c8ea00640 1 -- 172.21.15.7:0/356650585 shutdown_connections 2024-09-13T18:17:05.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.938+0000 7f8c8ea00640 1 -- 172.21.15.7:0/356650585 wait complete. 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.938+0000 7f8c8ea00640 1 Processor -- start 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ea00640 1 -- start start 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c88101fe0 0x7f8c88197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c881031d0 0x7f8c88198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ea00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c88103b90 0x7f8c8819f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ea00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8819fac0 con 0x7f8c881031d0 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ea00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8819fc30 con 0x7f8c88101fe0 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ea00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8819fdf0 con 0x7f8c88103b90 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c881031d0 0x7f8c88198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c7f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c881031d0 0x7f8c88198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55908/0 (socket says 172.21.15.7:55908) 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c7f400640 1 -- 172.21.15.7:0/1838014621 learned_addr learned my addr 172.21.15.7:0/1838014621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c87e00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c88101fe0 0x7f8c88197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.939+0000 7f8c8ca00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c88103b90 0x7f8c8819f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c7f400640 1 -- 172.21.15.7:0/1838014621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c88103b90 msgr2=0x7f8c8819f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c7f400640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c88103b90 0x7f8c8819f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c7f400640 1 -- 172.21.15.7:0/1838014621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c88101fe0 msgr2=0x7f8c88197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c7f400640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c88101fe0 0x7f8c88197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c7f400640 1 -- 172.21.15.7:0/1838014621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78009560 con 0x7f8c881031d0 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c7f400640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c881031d0 0x7f8c88198510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000e9f0 tx=0x7f8c7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c85600640 1 -- 172.21.15.7:0/1838014621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70009720 con 0x7f8c881031d0 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c881a00d0 con 0x7f8c881031d0 2024-09-13T18:17:05.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c85600640 1 -- 172.21.15.7:0/1838014621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c7000cd80 con 0x7f8c881031d0 2024-09-13T18:17:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c85600640 1 -- 172.21.15.7:0/1838014621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70010430 con 0x7f8c881031d0 2024-09-13T18:17:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.940+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c881a0590 con 0x7f8c881031d0 2024-09-13T18:17:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.941+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c88109510 con 0x7f8c881031d0 2024-09-13T18:17:05.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.943+0000 7f8c85600640 1 -- 172.21.15.7:0/1838014621 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f8c70005020 con 0x7f8c881031d0 2024-09-13T18:17:05.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.944+0000 7f8c85600640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8c6c0a1090 0x7f8c6c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:05.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.945+0000 7f8c85600640 1 -- 172.21.15.7:0/1838014621 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8c70014070 con 0x7f8c881031d0 2024-09-13T18:17:05.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.945+0000 7f8c87e00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8c6c0a1090 0x7f8c6c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:05.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.945+0000 7f8c87e00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8c6c0a1090 0x7f8c6c0a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c78005ab0 tx=0x7f8c780314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:05.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:05.948+0000 7f8c85600640 1 -- 172.21.15.7:0/1838014621 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8c700963c0 con 0x7f8c881031d0 2024-09-13T18:17:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:05 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/987847137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:17:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:05 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1482620161' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:17:06.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:05 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/987847137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:17:06.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:05 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1482620161' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:17:06.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.135+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c8810d8a0 con 0x7f8c881031d0 2024-09-13T18:17:06.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.137+0000 7f8c85600640 1 -- 172.21.15.7:0/1838014621 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7f8c700999e0 con 0x7f8c881031d0 2024-09-13T18:17:06.140 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:17:06.141 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:17:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8c6c0a1090 msgr2=0x7f8c6c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8c6c0a1090 0x7f8c6c0a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c78005ab0 tx=0x7f8c780314a0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c881031d0 msgr2=0x7f8c88198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c881031d0 0x7f8c88198510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000e9f0 tx=0x7f8c7000edf0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 shutdown_connections 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f8c6c0a1090 0x7f8c6c0a3550 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c88103b90 0x7f8c8819f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c881031d0 0x7f8c88198510 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 --2- 172.21.15.7:0/1838014621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c88101fe0 0x7f8c88197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 >> 172.21.15.7:0/1838014621 conn(0x7f8c880fd760 msgr2=0x7f8c881066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 shutdown_connections 2024-09-13T18:17:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.139+0000 7f8c8ea00640 1 -- 172.21.15.7:0/1838014621 wait complete. 2024-09-13T18:17:06.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:15:04.217247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:15:05.500183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:17:06.159 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:17:06.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:05 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/987847137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:17:06.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:05 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1482620161' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:17:06.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 -- 172.21.15.7:0/1507516022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 msgr2=0x7ff0481023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 --2- 172.21.15.7:0/1507516022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 0x7ff0481023d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff038009ca0 tx=0x7ff03802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 -- 172.21.15.7:0/1507516022 shutdown_connections 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 --2- 172.21.15.7:0/1507516022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 0x7ff04810a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 --2- 172.21.15.7:0/1507516022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0481031c0 0x7ff048103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 --2- 172.21.15.7:0/1507516022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 0x7ff0481023d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 -- 172.21.15.7:0/1507516022 >> 172.21.15.7:0/1507516022 conn(0x7ff0480fd730 msgr2=0x7ff0480ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 -- 172.21.15.7:0/1507516022 shutdown_connections 2024-09-13T18:17:06.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.317+0000 7ff04d000640 1 -- 172.21.15.7:0/1507516022 wait complete. 2024-09-13T18:17:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.318+0000 7ff04d000640 1 Processor -- start 2024-09-13T18:17:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.318+0000 7ff04d000640 1 -- start start 2024-09-13T18:17:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.318+0000 7ff04d000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 0x7ff048197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.318+0000 7ff04d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0481031c0 0x7ff0481984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff04d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 0x7ff04819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff04d000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04819faa0 con 0x7ff048103b80 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff04d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04819fc10 con 0x7ff0481031c0 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff04d000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04819fdd0 con 0x7ff048101fd0 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff046800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 0x7ff04819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff046800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 0x7ff04819f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55916/0 (socket says 172.21.15.7:55916) 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff045e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 0x7ff048197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff046800640 1 -- 172.21.15.7:0/1149082660 learned_addr learned my addr 172.21.15.7:0/1149082660 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff03d400640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0481031c0 0x7ff0481984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff045e00640 1 -- 172.21.15.7:0/1149082660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0481031c0 msgr2=0x7ff0481984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff045e00640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0481031c0 0x7ff0481984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff045e00640 1 -- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 msgr2=0x7ff04819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff045e00640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 0x7ff04819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff045e00640 1 -- 172.21.15.7:0/1149082660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009900 con 0x7ff048101fd0 2024-09-13T18:17:06.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff046800640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 0x7ff04819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.319+0000 7ff045e00640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 0x7ff048197fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff03802ade0 tx=0x7ff038032f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.320+0000 7ff03f400640 1 -- 172.21.15.7:0/1149082660 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038003b70 con 0x7ff048101fd0 2024-09-13T18:17:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.320+0000 7ff03f400640 1 -- 172.21.15.7:0/1149082660 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff038040070 con 0x7ff048101fd0 2024-09-13T18:17:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.320+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0481a0050 con 0x7ff048101fd0 2024-09-13T18:17:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.320+0000 7ff03f400640 1 -- 172.21.15.7:0/1149082660 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038004510 con 0x7ff048101fd0 2024-09-13T18:17:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.320+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0481a0530 con 0x7ff048101fd0 2024-09-13T18:17:06.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.321+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff048109400 con 0x7ff048101fd0 2024-09-13T18:17:06.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.323+0000 7ff03f400640 1 -- 172.21.15.7:0/1149082660 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7ff038042030 con 0x7ff048101fd0 2024-09-13T18:17:06.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.324+0000 7ff03f400640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff02c0a1090 0x7ff02c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.324+0000 7ff03f400640 1 -- 172.21.15.7:0/1149082660 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff0380eddd0 con 0x7ff048101fd0 2024-09-13T18:17:06.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.324+0000 7ff03d400640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff02c0a1090 0x7ff02c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.325+0000 7ff03d400640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff02c0a1090 0x7ff02c0a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff0481994c0 tx=0x7ff030005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.326+0000 7ff03f400640 1 -- 172.21.15.7:0/1149082660 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff0380b75a0 con 0x7ff048101fd0 2024-09-13T18:17:06.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.505+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff04810d8e0 con 0x7ff048101fd0 2024-09-13T18:17:06.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.506+0000 7ff03f400640 1 -- 172.21.15.7:0/1149082660 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0380babc0 con 0x7ff048101fd0 2024-09-13T18:17:06.509 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff02c0a1090 msgr2=0x7ff02c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff02c0a1090 0x7ff02c0a3550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff0481994c0 tx=0x7ff030005f90 comp rx=0 tx=0).stop 2024-09-13T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 msgr2=0x7ff048197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 0x7ff048197fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff03802ade0 tx=0x7ff038032f20 comp rx=0 tx=0).stop 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 shutdown_connections 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff02c0a1090 0x7ff02c0a3550 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff048103b80 0x7ff04819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0481031c0 0x7ff0481984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 --2- 172.21.15.7:0/1149082660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048101fd0 0x7ff048197fb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 >> 172.21.15.7:0/1149082660 conn(0x7ff0480fd730 msgr2=0x7ff0481065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 shutdown_connections 2024-09-13T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.508+0000 7ff04d000640 1 -- 172.21.15.7:0/1149082660 wait complete. 2024-09-13T18:17:06.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:17:06.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.683+0000 7f0879a00640 1 -- 172.21.15.7:0/3668778470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 msgr2=0x7f08741021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.683+0000 7f0879a00640 1 --2- 172.21.15.7:0/3668778470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f08741021b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0864009900 tx=0x7f086402a410 comp rx=0 tx=0).stop 2024-09-13T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.684+0000 7f0879a00640 1 -- 172.21.15.7:0/3668778470 shutdown_connections 2024-09-13T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.684+0000 7f0879a00640 1 --2- 172.21.15.7:0/3668778470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874103960 0x7f087410a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.684+0000 7f0879a00640 1 --2- 172.21.15.7:0/3668778470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0874102fa0 0x7f0874103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.684+0000 7f0879a00640 1 --2- 172.21.15.7:0/3668778470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f08741021b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.684+0000 7f0879a00640 1 -- 172.21.15.7:0/3668778470 >> 172.21.15.7:0/3668778470 conn(0x7f08740fd530 msgr2=0x7f08740ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.684+0000 7f0879a00640 1 -- 172.21.15.7:0/3668778470 shutdown_connections 2024-09-13T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.684+0000 7f0879a00640 1 -- 172.21.15.7:0/3668778470 wait complete. 2024-09-13T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 Processor -- start 2024-09-13T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 -- start start 2024-09-13T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f0874197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874102fa0 0x7f0874198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0874103960 0x7f087419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087419f910 con 0x7f0874101db0 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087419fa80 con 0x7f0874102fa0 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087419fc40 con 0x7f0874103960 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0873e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f0874197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0873e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f0874197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55932/0 (socket says 172.21.15.7:55932) 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0873e00640 1 -- 172.21.15.7:0/3430205245 learned_addr learned my addr 172.21.15.7:0/3430205245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f0879000640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0874103960 0x7f087419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.685+0000 7f086be00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874102fa0 0x7f0874198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0873e00640 1 -- 172.21.15.7:0/3430205245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0874103960 msgr2=0x7f087419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0873e00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0874103960 0x7f087419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0873e00640 1 -- 172.21.15.7:0/3430205245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874102fa0 msgr2=0x7f0874198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0873e00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874102fa0 0x7f0874198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0873e00640 1 -- 172.21.15.7:0/3430205245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864009560 con 0x7f0874101db0 2024-09-13T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0873e00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f0874197e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0864031500 tx=0x7f0864003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0871600640 1 -- 172.21.15.7:0/3430205245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864003e00 con 0x7f0874101db0 2024-09-13T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0871600640 1 -- 172.21.15.7:0/3430205245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0864031c70 con 0x7f0874101db0 2024-09-13T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087419fec0 con 0x7f0874101db0 2024-09-13T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0871600640 1 -- 172.21.15.7:0/3430205245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086403bc20 con 0x7f0874101db0 2024-09-13T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.686+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08741a02e0 con 0x7f0874101db0 2024-09-13T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.688+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08741092e0 con 0x7f0874101db0 2024-09-13T18:17:06.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.689+0000 7f0871600640 1 -- 172.21.15.7:0/3430205245 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f08640317b0 con 0x7f0874101db0 2024-09-13T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.690+0000 7f0871600640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f08580a1110 0x7f08580a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.691+0000 7f0871600640 1 -- 172.21.15.7:0/3430205245 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f08640ed0b0 con 0x7f0874101db0 2024-09-13T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.691+0000 7f086be00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f08580a1110 0x7f08580a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:06.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.692+0000 7f086be00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f08580a1110 0x7f08580a35d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0874199330 tx=0x7f085c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:06.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.694+0000 7f0871600640 1 -- 172.21.15.7:0/3430205245 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f08640b6850 con 0x7f0874101db0 2024-09-13T18:17:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:06 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2333879202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:17:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:06 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1838014621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:06 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1149082660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:17:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:06 smithi007 ceph-mon[30588]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.901+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f087402c480 con 0x7f0874101db0 2024-09-13T18:17:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.901+0000 7f0871600640 1 -- 172.21.15.7:0/3430205245 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08640b9e70 con 0x7f0874101db0 2024-09-13T18:17:06.905 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.903+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f08580a1110 msgr2=0x7f08580a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.903+0000 7f0879a00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f08580a1110 0x7f08580a35d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0874199330 tx=0x7f085c005f90 comp rx=0 tx=0).stop 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.903+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 msgr2=0x7f0874197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.903+0000 7f0879a00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f0874197e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0864031500 tx=0x7f0864003c10 comp rx=0 tx=0).stop 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 shutdown_connections 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f08580a1110 0x7f08580a35d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0874103960 0x7f087419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874102fa0 0x7f0874198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 --2- 172.21.15.7:0/3430205245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0874101db0 0x7f0874197e20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 >> 172.21.15.7:0/3430205245 conn(0x7f08740fd530 msgr2=0x7f08741064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 shutdown_connections 2024-09-13T18:17:06.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:06.904+0000 7f0879a00640 1 -- 172.21.15.7:0/3430205245 wait complete. 2024-09-13T18:17:06.924 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:17:07.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 -- 172.21.15.7:0/758520078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94103190 msgr2=0x7f5d94103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/758520078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94103190 0x7f5d94103610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009900 tx=0x7f5d8002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 -- 172.21.15.7:0/758520078 shutdown_connections 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/758520078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d94103b50 0x7f5d9410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/758520078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94103190 0x7f5d94103610 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/758520078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d94101fa0 0x7f5d941023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 -- 172.21.15.7:0/758520078 >> 172.21.15.7:0/758520078 conn(0x7f5d940fd720 msgr2=0x7f5d940ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 -- 172.21.15.7:0/758520078 shutdown_connections 2024-09-13T18:17:07.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.081+0000 7f5d9ba00640 1 -- 172.21.15.7:0/758520078 wait complete. 2024-09-13T18:17:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 Processor -- start 2024-09-13T18:17:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 -- start start 2024-09-13T18:17:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94101fa0 0x7f5d94197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d94103190 0x7f5d94198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d94103b50 0x7f5d9419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9419fa30 con 0x7f5d94101fa0 2024-09-13T18:17:07.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9419fba0 con 0x7f5d94103b50 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.082+0000 7f5d9ba00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9419fd60 con 0x7f5d94103190 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94101fa0 0x7f5d94197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94101fa0 0x7f5d94197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55948/0 (socket says 172.21.15.7:55948) 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 -- 172.21.15.7:0/3472337589 learned_addr learned my addr 172.21.15.7:0/3472337589 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d93e00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d94103190 0x7f5d94198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99a00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d94103b50 0x7f5d9419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 -- 172.21.15.7:0/3472337589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d94103190 msgr2=0x7f5d94198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d94103190 0x7f5d94198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 -- 172.21.15.7:0/3472337589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d94103b50 msgr2=0x7f5d9419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d94103b50 0x7f5d9419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 -- 172.21.15.7:0/3472337589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80009560 con 0x7f5d94101fa0 2024-09-13T18:17:07.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d93e00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d94103190 0x7f5d94198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:07.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.083+0000 7f5d99000640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94101fa0 0x7f5d94197f40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800e9c0 tx=0x7f5d8800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:07.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.084+0000 7f5d91600640 1 -- 172.21.15.7:0/3472337589 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d880096e0 con 0x7f5d94101fa0 2024-09-13T18:17:07.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.084+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9419ffe0 con 0x7f5d94101fa0 2024-09-13T18:17:07.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.084+0000 7f5d91600640 1 -- 172.21.15.7:0/3472337589 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d880044f0 con 0x7f5d94101fa0 2024-09-13T18:17:07.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.084+0000 7f5d91600640 1 -- 172.21.15.7:0/3472337589 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88010430 con 0x7f5d94101fa0 2024-09-13T18:17:07.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.084+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d941a0460 con 0x7f5d94101fa0 2024-09-13T18:17:07.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.085+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d941093e0 con 0x7f5d94101fa0 2024-09-13T18:17:07.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.087+0000 7f5d91600640 1 -- 172.21.15.7:0/3472337589 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f5d880035f0 con 0x7f5d94101fa0 2024-09-13T18:17:07.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.088+0000 7f5d91600640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d7c0a1090 0x7f5d7c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.089+0000 7f5d91600640 1 -- 172.21.15.7:0/3472337589 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5d88014070 con 0x7f5d94101fa0 2024-09-13T18:17:07.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.089+0000 7f5d93e00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d7c0a1090 0x7f5d7c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.090+0000 7f5d93e00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d7c0a1090 0x7f5d7c0a3550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d80000c00 tx=0x7f5d80005760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:07.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.092+0000 7f5d91600640 1 -- 172.21.15.7:0/3472337589 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d88096540 con 0x7f5d94101fa0 2024-09-13T18:17:07.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:06 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2333879202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:17:07.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:06 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1838014621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:07.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:06 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1149082660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:17:07.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:06 smithi116 ceph-mon[35109]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:06 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2333879202' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:17:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:06 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1838014621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:06 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1149082660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:17:07.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:06 smithi067 ceph-mon[35103]: pgmap v347: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.271+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d9410d860 con 0x7f5d94101fa0 2024-09-13T18:17:07.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.272+0000 7f5d91600640 1 -- 172.21.15.7:0/3472337589 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d88099b60 con 0x7f5d94101fa0 2024-09-13T18:17:07.275 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T18:17:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d7c0a1090 msgr2=0x7f5d7c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d7c0a1090 0x7f5d7c0a3550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d80000c00 tx=0x7f5d80005760 comp rx=0 tx=0).stop 2024-09-13T18:17:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94101fa0 msgr2=0x7f5d94197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94101fa0 0x7f5d94197f40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800e9c0 tx=0x7f5d8800ee80 comp rx=0 tx=0).stop 2024-09-13T18:17:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 shutdown_connections 2024-09-13T18:17:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f5d7c0a1090 0x7f5d7c0a3550 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d94103b50 0x7f5d9419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d94103190 0x7f5d94198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 --2- 172.21.15.7:0/3472337589 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d94101fa0 0x7f5d94197f40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 >> 172.21.15.7:0/3472337589 conn(0x7f5d940fd720 msgr2=0x7f5d941065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 shutdown_connections 2024-09-13T18:17:07.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.274+0000 7f5d9ba00640 1 -- 172.21.15.7:0/3472337589 wait complete. 2024-09-13T18:17:07.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:17:07.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 -- 172.21.15.7:0/838394213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff814100fd0 msgr2=0x7ff814101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 --2- 172.21.15.7:0/838394213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff814100fd0 0x7ff814101450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009860 tx=0x7ff7fc02a340 comp rx=0 tx=0).stop 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 -- 172.21.15.7:0/838394213 shutdown_connections 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 --2- 172.21.15.7:0/838394213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814101990 0x7ff814108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 --2- 172.21.15.7:0/838394213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff814100fd0 0x7ff814101450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 --2- 172.21.15.7:0/838394213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff8140ffde0 0x7ff8141001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 -- 172.21.15.7:0/838394213 >> 172.21.15.7:0/838394213 conn(0x7ff8140fb540 msgr2=0x7ff8140fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 -- 172.21.15.7:0/838394213 shutdown_connections 2024-09-13T18:17:07.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.449+0000 7ff818a00640 1 -- 172.21.15.7:0/838394213 wait complete. 2024-09-13T18:17:07.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 Processor -- start 2024-09-13T18:17:07.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 -- start start 2024-09-13T18:17:07.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8140ffde0 0x7ff814198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814100fd0 0x7ff814198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814101990 0x7ff81419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81419fb40 con 0x7ff814100fd0 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81419fcb0 con 0x7ff814101990 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.450+0000 7ff818a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81419fe70 con 0x7ff8140ffde0 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff80be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814100fd0 0x7ff814198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff80be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814100fd0 0x7ff814198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55970/0 (socket says 172.21.15.7:55970) 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff80be00640 1 -- 172.21.15.7:0/1850791184 learned_addr learned my addr 172.21.15.7:0/1850791184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff811e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8140ffde0 0x7ff814198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff812800640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814101990 0x7ff81419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff811e00640 1 -- 172.21.15.7:0/1850791184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814101990 msgr2=0x7ff81419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff811e00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814101990 0x7ff81419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff811e00640 1 -- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814100fd0 msgr2=0x7ff814198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff811e00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814100fd0 0x7ff814198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff811e00640 1 -- 172.21.15.7:0/1850791184 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804009560 con 0x7ff8140ffde0 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.451+0000 7ff80be00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814100fd0 0x7ff814198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.452+0000 7ff811e00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8140ffde0 0x7ff814198050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff814100e30 tx=0x7ff80400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.452+0000 7ff80aa00640 1 -- 172.21.15.7:0/1850791184 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804004440 con 0x7ff8140ffde0 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.452+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc009490 con 0x7ff8140ffde0 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.452+0000 7ff80aa00640 1 -- 172.21.15.7:0/1850791184 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff80400cd80 con 0x7ff8140ffde0 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.452+0000 7ff80aa00640 1 -- 172.21.15.7:0/1850791184 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804019480 con 0x7ff8140ffde0 2024-09-13T18:17:07.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.452+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8141a04f0 con 0x7ff8140ffde0 2024-09-13T18:17:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.453+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8141925f0 con 0x7ff8140ffde0 2024-09-13T18:17:07.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.455+0000 7ff80aa00640 1 -- 172.21.15.7:0/1850791184 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7ff80400c8c0 con 0x7ff8140ffde0 2024-09-13T18:17:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.456+0000 7ff80aa00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7f80a1110 0x7ff7f80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.457+0000 7ff80aa00640 1 -- 172.21.15.7:0/1850791184 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff804014070 con 0x7ff8140ffde0 2024-09-13T18:17:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.457+0000 7ff80be00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7f80a1110 0x7ff7f80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.457+0000 7ff80be00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7f80a1110 0x7ff7f80a35d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc02a930 tx=0x7ff7fc0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:07.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.460+0000 7ff80aa00640 1 -- 172.21.15.7:0/1850791184 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff804096520 con 0x7ff8140ffde0 2024-09-13T18:17:07.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.679+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff81410b680 con 0x7ff8140ffde0 2024-09-13T18:17:07.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.680+0000 7ff80aa00640 1 -- 172.21.15.7:0/1850791184 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10889 (secure 0 0 0) 0x7ff804099b40 con 0x7ff8140ffde0 2024-09-13T18:17:07.684 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:17:07.684 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:15:12.707791+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:17:07.684 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7f80a1110 msgr2=0x7ff7f80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7f80a1110 0x7ff7f80a35d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc02a930 tx=0x7ff7fc0058b0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8140ffde0 msgr2=0x7ff814198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8140ffde0 0x7ff814198050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff814100e30 tx=0x7ff80400ee50 comp rx=0 tx=0).stop 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 shutdown_connections 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7ff7f80a1110 0x7ff7f80a35d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff814101990 0x7ff81419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.682+0000 7ff818a00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff814100fd0 0x7ff814198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.683+0000 7ff818a00640 1 --2- 172.21.15.7:0/1850791184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8140ffde0 0x7ff814198050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.683+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 >> 172.21.15.7:0/1850791184 conn(0x7ff8140fb540 msgr2=0x7ff814106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:07.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.683+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 shutdown_connections 2024-09-13T18:17:07.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.683+0000 7ff818a00640 1 -- 172.21.15.7:0/1850791184 wait complete. 2024-09-13T18:17:07.702 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:17:07.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 -- 172.21.15.7:0/2319081392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 msgr2=0x7fd4a4101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 --2- 172.21.15.7:0/2319081392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4101440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009ca0 tx=0x7fd48c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 -- 172.21.15.7:0/2319081392 shutdown_connections 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 --2- 172.21.15.7:0/2319081392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a4101980 0x7fd4a4108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 --2- 172.21.15.7:0/2319081392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4101440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 --2- 172.21.15.7:0/2319081392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4a40ffdd0 0x7fd4a41001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 -- 172.21.15.7:0/2319081392 >> 172.21.15.7:0/2319081392 conn(0x7fd4a40fb590 msgr2=0x7fd4a40fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 -- 172.21.15.7:0/2319081392 shutdown_connections 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.855+0000 7fd4a9200640 1 -- 172.21.15.7:0/2319081392 wait complete. 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.856+0000 7fd4a9200640 1 Processor -- start 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.856+0000 7fd4a9200640 1 -- start start 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a9200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4a40ffdd0 0x7fd4a4195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a4101980 0x7fd4a419d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a9200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a419d900 con 0x7fd4a4100fc0 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a419da70 con 0x7fd4a4101980 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a9200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a419dc30 con 0x7fd4a40ffdd0 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55996/0 (socket says 172.21.15.7:55996) 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 -- 172.21.15.7:0/1905796201 learned_addr learned my addr 172.21.15.7:0/1905796201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a1e00640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4a40ffdd0 0x7fd4a4195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd4a2800640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a4101980 0x7fd4a419d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 -- 172.21.15.7:0/1905796201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4a40ffdd0 msgr2=0x7fd4a4195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4a40ffdd0 0x7fd4a4195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 -- 172.21.15.7:0/1905796201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a4101980 msgr2=0x7fd4a419d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a4101980 0x7fd4a419d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.857+0000 7fd499400640 1 -- 172.21.15.7:0/1905796201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009900 con 0x7fd4a4100fc0 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.858+0000 7fd499400640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4196350 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd48c000f80 tx=0x7fd48c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.858+0000 7fd49b400640 1 -- 172.21.15.7:0/1905796201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c003b70 con 0x7fd4a4100fc0 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.858+0000 7fd49b400640 1 -- 172.21.15.7:0/1905796201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd48c040070 con 0x7fd4a4100fc0 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.858+0000 7fd49b400640 1 -- 172.21.15.7:0/1905796201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0044a0 con 0x7fd4a4100fc0 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.858+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a419deb0 con 0x7fd4a4100fc0 2024-09-13T18:17:07.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.858+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a419e2e0 con 0x7fd4a4100fc0 2024-09-13T18:17:07.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.859+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a41072b0 con 0x7fd4a4100fc0 2024-09-13T18:17:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.861+0000 7fd49b400640 1 -- 172.21.15.7:0/1905796201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fd48c042030 con 0x7fd4a4100fc0 2024-09-13T18:17:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.862+0000 7fd49b400640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd4880a1090 0x7fd4880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.862+0000 7fd49b400640 1 -- 172.21.15.7:0/1905796201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd48c0edcf0 con 0x7fd4a4100fc0 2024-09-13T18:17:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.862+0000 7fd4a1e00640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd4880a1090 0x7fd4880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:07.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.863+0000 7fd4a1e00640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd4880a1090 0x7fd4880a3550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4100e20 tx=0x7fd494005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:07.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:07.866+0000 7fd49b400640 1 -- 172.21.15.7:0/1905796201 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd48c0b74c0 con 0x7fd4a4100fc0 2024-09-13T18:17:08.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3430205245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:17:08.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3472337589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:17:08.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:07 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1850791184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:17:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.048+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4a410b900 con 0x7fd4a4100fc0 2024-09-13T18:17:08.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.050+0000 7fd49b400640 1 -- 172.21.15.7:0/1905796201 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7fd48c0baae0 con 0x7fd4a4100fc0 2024-09-13T18:17:08.053 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:17:08.054 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:17:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd4880a1090 msgr2=0x7fd4880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd4880a1090 0x7fd4880a3550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4100e20 tx=0x7fd494005f90 comp rx=0 tx=0).stop 2024-09-13T18:17:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 msgr2=0x7fd4a4196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4196350 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd48c000f80 tx=0x7fd48c032f20 comp rx=0 tx=0).stop 2024-09-13T18:17:08.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 shutdown_connections 2024-09-13T18:17:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd4880a1090 0x7fd4880a3550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4a4101980 0x7fd4a419d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4a4100fc0 0x7fd4a4196350 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 --2- 172.21.15.7:0/1905796201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4a40ffdd0 0x7fd4a4195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 >> 172.21.15.7:0/1905796201 conn(0x7fd4a40fb590 msgr2=0x7fd4a4104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 shutdown_connections 2024-09-13T18:17:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.053+0000 7fd4a9200640 1 -- 172.21.15.7:0/1905796201 wait complete. 2024-09-13T18:17:08.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T18:15:06.002659+0000', 'modified': '2024-09-13T18:15:12.707791+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24581, 'mds_1': 24559, 'mds_2': 24538, 'mds_3': 24533, 'mds_4': 24526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14517': {'gid': 14517, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6841/4101588502', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6840', 'nonce': 4101588502}, {'type': 'v1', 'addr': '172.21.15.7:6841', 'nonce': 4101588502}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.67:6833/344470719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 344470719}, {'type': 'v1', 'addr': '172.21.15.67:6833', 'nonce': 344470719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24466': {'gid': 24466, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6833/3628414330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6832', 'nonce': 3628414330}, {'type': 'v1', 'addr': '172.21.15.116:6833', 'nonce': 3628414330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24473': {'gid': 24473, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6835/379477361', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 379477361}, {'type': 'v1', 'addr': '172.21.15.7:6835', 'nonce': 379477361}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24503': {'gid': 24503, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.67:6835/833350667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 833350667}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 833350667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24526': {'gid': 24526, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.116:6835/4071332946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 4071332946}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 4071332946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.67:6837/2829823752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6836', 'nonce': 2829823752}, {'type': 'v1', 'addr': '172.21.15.67:6837', 'nonce': 2829823752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.116:6837/1196913954', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 1196913954}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 1196913954}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24559': {'gid': 24559, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.116:6839/284751360', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 284751360}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 284751360}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6839/2314229455', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6838', 'nonce': 2314229455}, {'type': 'v1', 'addr': '172.21.15.67:6839', 'nonce': 2314229455}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:17:08.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-13T18:17:08.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-13T18:17:08.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3430205245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:17:08.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3472337589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:17:08.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:07 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1850791184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:17:08.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 -- 172.21.15.7:0/483410324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 msgr2=0x7f6b981023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 --2- 172.21.15.7:0/483410324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b981023b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009900 tx=0x7f6b8802a410 comp rx=0 tx=0).stop 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 -- 172.21.15.7:0/483410324 shutdown_connections 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 --2- 172.21.15.7:0/483410324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b98103b60 0x7f6b9810a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 --2- 172.21.15.7:0/483410324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b981031a0 0x7f6b98103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 --2- 172.21.15.7:0/483410324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b981023b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 -- 172.21.15.7:0/483410324 >> 172.21.15.7:0/483410324 conn(0x7f6b980fd770 msgr2=0x7f6b980ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 -- 172.21.15.7:0/483410324 shutdown_connections 2024-09-13T18:17:08.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.229+0000 7f6b9e600640 1 -- 172.21.15.7:0/483410324 wait complete. 2024-09-13T18:17:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 Processor -- start 2024-09-13T18:17:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 -- start start 2024-09-13T18:17:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b98197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b981031a0 0x7f6b981984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b98103b60 0x7f6b9819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9819fa60 con 0x7f6b98101fb0 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9819fbd0 con 0x7f6b98103b60 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.230+0000 7f6b9e600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9819fd90 con 0x7f6b981031a0 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b98197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b98197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56020/0 (socket says 172.21.15.7:56020) 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 -- 172.21.15.7:0/3904076967 learned_addr learned my addr 172.21.15.7:0/3904076967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97e00640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b98103b60 0x7f6b9819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b981031a0 0x7f6b981984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 -- 172.21.15.7:0/3904076967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b981031a0 msgr2=0x7f6b981984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b981031a0 0x7f6b981984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 -- 172.21.15.7:0/3904076967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b98103b60 msgr2=0x7f6b9819f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b98103b60 0x7f6b9819f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 -- 172.21.15.7:0/3904076967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b88009560 con 0x7f6b98101fb0 2024-09-13T18:17:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.231+0000 7f6b97400640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b98197f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b880057c0 tx=0x7f6b880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.232+0000 7f6b94c00640 1 -- 172.21.15.7:0/3904076967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88004b50 con 0x7f6b98101fb0 2024-09-13T18:17:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.232+0000 7f6b94c00640 1 -- 172.21.15.7:0/3904076967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b88004cb0 con 0x7f6b98101fb0 2024-09-13T18:17:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.232+0000 7f6b94c00640 1 -- 172.21.15.7:0/3904076967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88031ae0 con 0x7f6b98101fb0 2024-09-13T18:17:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.232+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b981a0010 con 0x7f6b98101fb0 2024-09-13T18:17:08.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.232+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b981a04c0 con 0x7f6b98101fb0 2024-09-13T18:17:08.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 Processor -- start 2024-09-13T18:17:08.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 -- start start 2024-09-13T18:17:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6b94c00640 1 -- 172.21.15.7:0/3904076967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f6b88003c40 con 0x7f6b98101fb0 2024-09-13T18:17:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c85b30 0x556335c85f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c8d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335befab0 con 0x556335c86470 2024-09-13T18:17:08.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335bed240 con 0x556335c85b30 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6ba1412740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335be8b30 con 0x556335c8b500 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.236+0000 7f6b97400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c85b30 0x556335c85f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c85b30 0x556335c85f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:48866/0 (socket says 172.21.15.7:48866) 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 -- 172.21.15.7:0/824883541 learned_addr learned my addr 172.21.15.7:0/824883541 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c8d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 -- 172.21.15.7:0/824883541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 msgr2=0x556335c8d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c8d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 -- 172.21.15.7:0/824883541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 msgr2=0x556335c8af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 -- 172.21.15.7:0/824883541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556335bb3bd0 con 0x556335c85b30 2024-09-13T18:17:08.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b97e00640 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c85b30 0x556335c85f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009fd0 tx=0x7f6b900118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49a4ebd2ae84013 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.237+0000 7f6b8cc00640 1 -- 172.21.15.7:0/824883541 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90004d20 con 0x556335c85b30 2024-09-13T18:17:08.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6b8cc00640 1 -- 172.21.15.7:0/824883541 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b90004e80 con 0x556335c85b30 2024-09-13T18:17:08.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6b8cc00640 1 -- 172.21.15.7:0/824883541 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90005280 con 0x556335c85b30 2024-09-13T18:17:08.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6b94c00640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6b7c0a1110 0x7f6b7c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6b94c00640 1 -- 172.21.15.7:0/3904076967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6b880ed750 con 0x7f6b98101fb0 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6b97400640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6b7c0a1110 0x7f6b7c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6ba1412740 1 -- 172.21.15.7:0/824883541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c85b30 msgr2=0x556335c85f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6ba1412740 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c85b30 0x556335c85f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009fd0 tx=0x7f6b900118d0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6ba1412740 1 -- 172.21.15.7:0/824883541 shutdown_connections 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6ba1412740 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c8d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6ba1412740 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6ba1412740 1 --2- 172.21.15.7:0/824883541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c85b30 0x556335c85f30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.238+0000 7f6ba1412740 1 -- 172.21.15.7:0/824883541 >> 172.21.15.7:0/824883541 conn(0x556335c811a0 msgr2=0x556335c815a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.239+0000 7f6ba1412740 1 -- 172.21.15.7:0/824883541 shutdown_connections 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.239+0000 7f6b97400640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6b7c0a1110 0x7f6b7c0a35d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b880ba900 tx=0x7f6b880f3530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.239+0000 7f6ba1412740 1 -- 172.21.15.7:0/824883541 wait complete. 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.239+0000 7f6ba1412740 1 -- start start 2024-09-13T18:17:08.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.239+0000 7f6ba1412740 1 Processor -- start 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c8f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c8b500 0x556335c96d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6ba1412740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335b8a260 con 0x556335c86470 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6ba1412740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335b89f00 con 0x556335c8b500 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6ba1412740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55633594ff20 con 0x556335c85b30 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6ba1412740 10 client.0 _ll_register_callbacks cb 0x556335be21a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56050/0 (socket says 172.21.15.7:56050) 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c8b500 0x556335c96d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 -- 172.21.15.7:0/32383155 learned_addr learned my addr 172.21.15.7:0/32383155 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b97e00640 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c8f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 -- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 msgr2=0x556335c8f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c8f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 -- 172.21.15.7:0/32383155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c8b500 msgr2=0x556335c96d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c8b500 0x556335c96d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.240+0000 7f6b8fe00640 1 -- 172.21.15.7:0/32383155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b90009c80 con 0x556335c86470 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8fcd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b800126e0 tx=0x7f6b80012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a176f6240c5a4538 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6b85600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6b85600640 1 -- 172.21.15.7:0/32383155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80017070 con 0x556335c86470 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6b85600640 1 -- 172.21.15.7:0/32383155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6b8000f920 con 0x556335c86470 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563358dc3c0 con 0x556335c86470 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6b85600640 1 -- 172.21.15.7:0/32383155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b8000fae0 con 0x556335c86470 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6ba1412740 10 client.15126 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556335be71b0 con 0x556335c86470 2024-09-13T18:17:08.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3430205245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:17:08.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3472337589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:17:08.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:07 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1850791184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.241+0000 7f6b85600640 1 -- 172.21.15.7:0/32383155 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5563358dc3c0 con 0x556335c86470 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6b85600640 1 -- 172.21.15.7:0/32383155 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6b8001c420 con 0x556335c86470 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6ba1412740 10 client.15126 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6ba1412740 10 client.15126 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6ba1412740 20 client.15126 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6ba1412740 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335c9bbc0 0x556335c9fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6ba1412740 4 client.15126 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 --> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563358ed6c0 con 0x556335c9bbc0 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.242+0000 7f6b97e00640 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335c9bbc0 0x556335c9fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.243+0000 7f6b97e00640 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335c9bbc0 0x556335c9fd20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=553a4e8ef90f405b server_cookie=3ebf6b47973b9e7a in_seq=0 out_seq=0 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.243+0000 7f6b85600640 10 client.15126 ms_handle_connect on v2:172.21.15.116:6834/4071332946 2024-09-13T18:17:08.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.243+0000 7f6b85600640 1 -- 172.21.15.7:0/32383155 <== mds.4 v2:172.21.15.116:6834/4071332946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5563358ed6c0 con 0x556335c9bbc0 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.243+0000 7f6b85600640 10 client.15126 handle_command_reply: tid=0 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.243+0000 7f6ba1412740 1 client.15126 shutdown 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.243+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 msgr2=0x556335c8fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.243+0000 7f6ba1412740 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8fcd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b800126e0 tx=0x7f6b80012ba0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 shutdown_connections 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335c9bbc0 0x556335c9fd20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c8b500 0x556335c96d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c86470 0x556335c8fcd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 --2- 172.21.15.7:0/32383155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c8f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 >> 172.21.15.7:0/32383155 conn(0x556335c811a0 msgr2=0x556335c829b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6b85600640 0 client.15126 ms_handle_reset on v2:172.21.15.116:6834/4071332946 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 shutdown_connections 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 1 -- 172.21.15.7:0/32383155 wait complete. 2024-09-13T18:17:08.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.244+0000 7f6ba1412740 20 client.15126 trim_cache size 0 max 16384 2024-09-13T18:17:08.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 Processor -- start 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 -- start start 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c97780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c96cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c8b500 0x556335c872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335c8e0d0 con 0x556335c8b500 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335c81e30 con 0x556335c86470 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6ba1412740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563358ed6c0 con 0x556335c85b30 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c8b500 0x556335c872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c97780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6b8fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c96cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c97780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:47068/0 (socket says 172.21.15.7:47068) 2024-09-13T18:17:08.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.260+0000 7f6b97e00640 1 -- 172.21.15.7:0/1575898175 learned_addr learned my addr 172.21.15.7:0/1575898175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b97e00640 1 -- 172.21.15.7:0/1575898175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 msgr2=0x556335c96cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b97e00640 1 --2- 172.21.15.7:0/1575898175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c96cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b97e00640 1 -- 172.21.15.7:0/1575898175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c8b500 msgr2=0x556335c872f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b97e00640 1 --2- 172.21.15.7:0/1575898175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c8b500 0x556335c872f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b97e00640 1 -- 172.21.15.7:0/1575898175 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556335b89470 con 0x556335c85b30 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b97e00640 1 --2- 172.21.15.7:0/1575898175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c97780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b90011dd0 tx=0x7f6b900118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50e86b1051f9bddc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b8d600640 1 -- 172.21.15.7:0/1575898175 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90033040 con 0x556335c85b30 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b8d600640 1 -- 172.21.15.7:0/1575898175 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b90034040 con 0x556335c85b30 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.261+0000 7f6b8d600640 1 -- 172.21.15.7:0/1575898175 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9002e450 con 0x556335c85b30 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 -- 172.21.15.7:0/1575898175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 msgr2=0x556335c97780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 --2- 172.21.15.7:0/1575898175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c97780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b90011dd0 tx=0x7f6b900118d0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 -- 172.21.15.7:0/1575898175 shutdown_connections 2024-09-13T18:17:08.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 --2- 172.21.15.7:0/1575898175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c8b500 0x556335c872f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 --2- 172.21.15.7:0/1575898175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c96cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 --2- 172.21.15.7:0/1575898175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c85b30 0x556335c97780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 -- 172.21.15.7:0/1575898175 >> 172.21.15.7:0/1575898175 conn(0x556335c811a0 msgr2=0x556335c8a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 -- 172.21.15.7:0/1575898175 shutdown_connections 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 -- 172.21.15.7:0/1575898175 wait complete. 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 -- start start 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.262+0000 7f6ba1412740 1 Processor -- start 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c85b30 0x556335c91500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c91a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6ba1412740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6ba1412740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335c96df0 con 0x556335c85b30 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6ba1412740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335c96f60 con 0x556335c86470 2024-09-13T18:17:08.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6ba1412740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556335cf19e0 con 0x556335c8b500 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6ba1412740 10 client.0 _ll_register_callbacks cb 0x7f6b80009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c85b30 0x556335c91500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c85b30 0x556335c91500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56066/0 (socket says 172.21.15.7:56066) 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 -- 172.21.15.7:0/4200008393 learned_addr learned my addr 172.21.15.7:0/4200008393 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c91a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 -- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 msgr2=0x556335c968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 -- 172.21.15.7:0/4200008393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 msgr2=0x556335c91a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c91a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 -- 172.21.15.7:0/4200008393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556335bb3bd0 con 0x556335c85b30 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b97e00640 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c85b30 0x556335c91500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009f70 tx=0x7f6b90000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae7940c07b4b5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.263+0000 7f6b85600640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:08.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6b85600640 1 -- 172.21.15.7:0/4200008393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000f6e0 con 0x556335c85b30 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6b85600640 1 -- 172.21.15.7:0/4200008393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6b9000f840 con 0x556335c85b30 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556335c12cd0 con 0x556335c85b30 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6b85600640 1 -- 172.21.15.7:0/4200008393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b9000fa00 con 0x556335c85b30 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6ba1412740 10 client.15132 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556335bae980 con 0x556335c85b30 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6b85600640 1 -- 172.21.15.7:0/4200008393 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556335c12cd0 con 0x556335c85b30 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.264+0000 7f6b85600640 1 -- 172.21.15.7:0/4200008393 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6b90021040 con 0x556335c85b30 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.265+0000 7f6ba1412740 10 client.15132 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.265+0000 7f6ba1412740 10 client.15132 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.265+0000 7f6ba1412740 20 client.15132 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.265+0000 7f6ba1412740 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335cf63a0 0x556335cf2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.265+0000 7f6ba1412740 4 client.15132 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:17:08.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.265+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 --> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556335940d10 con 0x556335cf63a0 2024-09-13T18:17:08.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.265+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335cf63a0 0x556335cf2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6b8fe00640 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335cf63a0 0x556335cf2d30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=defa754a1e6e7c3f server_cookie=14cba4d2383843e in_seq=0 out_seq=0 2024-09-13T18:17:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6b85600640 10 client.15132 ms_handle_connect on v2:172.21.15.116:6834/4071332946 2024-09-13T18:17:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6b85600640 1 -- 172.21.15.7:0/4200008393 <== mds.4 v2:172.21.15.116:6834/4071332946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x556335940d10 con 0x556335cf63a0 2024-09-13T18:17:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6b85600640 10 client.15132 handle_command_reply: tid=0 2024-09-13T18:17:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 client.15132 shutdown 2024-09-13T18:17:08.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c85b30 msgr2=0x556335c91500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c85b30 0x556335c91500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009f70 tx=0x7f6b90000f40 comp rx=0 tx=0).stop 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 shutdown_connections 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:6834/4071332946,v1:172.21.15.116:6835/4071332946] conn(0x556335cf63a0 0x556335cf2d30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556335c8b500 0x556335c968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556335c86470 0x556335c91a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6b85600640 0 client.15132 ms_handle_reset on v2:172.21.15.116:6834/4071332946 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 --2- 172.21.15.7:0/4200008393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556335c85b30 0x556335c91500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 >> 172.21.15.7:0/4200008393 conn(0x556335c811a0 msgr2=0x556335c8f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 shutdown_connections 2024-09-13T18:17:08.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 1 -- 172.21.15.7:0/4200008393 wait complete. 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.266+0000 7f6ba1412740 20 client.15132 trim_cache size 0 max 16384 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24526, 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:17:08.275 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:17:08.276 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 116.215544958, 2024-09-13T18:17:08.276 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:17:08.276 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:17:08.276 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:17:08.276 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 142.991853926 2024-09-13T18:17:08.276 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6b7c0a1110 msgr2=0x7f6b7c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6b7c0a1110 0x7f6b7c0a35d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b880ba900 tx=0x7f6b880f3530 comp rx=0 tx=0).stop 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 msgr2=0x7f6b98197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b98197f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b880057c0 tx=0x7f6b880055a0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 shutdown_connections 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f6b7c0a1110 0x7f6b7c0a35d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b98103b60 0x7f6b9819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b981031a0 0x7f6b981984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 --2- 172.21.15.7:0/3904076967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b98101fb0 0x7f6b98197f70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 >> 172.21.15.7:0/3904076967 conn(0x7f6b980fd770 msgr2=0x7f6b981066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 shutdown_connections 2024-09-13T18:17:08.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.267+0000 7f6b9e600640 1 -- 172.21.15.7:0/3904076967 wait complete. 2024-09-13T18:17:08.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 -- 172.21.15.7:0/3043939067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00ffdc0 msgr2=0x7f9bb01001c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3043939067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb01001c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009900 tx=0x7f9ba402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 -- 172.21.15.7:0/3043939067 shutdown_connections 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3043939067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb0101970 0x7f9bb0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3043939067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bb0100fb0 0x7f9bb0101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3043939067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb01001c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 -- 172.21.15.7:0/3043939067 >> 172.21.15.7:0/3043939067 conn(0x7f9bb00fb520 msgr2=0x7f9bb00fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 -- 172.21.15.7:0/3043939067 shutdown_connections 2024-09-13T18:17:08.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.441+0000 7f9bb8000640 1 -- 172.21.15.7:0/3043939067 wait complete. 2024-09-13T18:17:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.442+0000 7f9bb8000640 1 Processor -- start 2024-09-13T18:17:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.442+0000 7f9bb8000640 1 -- start start 2024-09-13T18:17:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.442+0000 7f9bb8000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb8000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bb0100fb0 0x7f9bb00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb8000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0101970 0x7f9bb0072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb8000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0073540 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb8000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00736b0 con 0x7f9bb0100fb0 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb8000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb019fde0 con 0x7f9bb0101970 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb0074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56086/0 (socket says 172.21.15.7:56086) 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 -- 172.21.15.7:0/3244915227 learned_addr learned my addr 172.21.15.7:0/3244915227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb6000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0101970 0x7f9bb0072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bb0100fb0 0x7f9bb00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 -- 172.21.15.7:0/3244915227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0101970 msgr2=0x7f9bb0072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0101970 0x7f9bb0072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 -- 172.21.15.7:0/3244915227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bb0100fb0 msgr2=0x7f9bb00728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bb0100fb0 0x7f9bb00728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 -- 172.21.15.7:0/3244915227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4009560 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bb0100fb0 0x7f9bb00728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.443+0000 7f9bb5600640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb0074260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009230 tx=0x7f9ba40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.444+0000 7f9bae000640 1 -- 172.21.15.7:0/3244915227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4004bd0 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.444+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb01a0030 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.444+0000 7f9bae000640 1 -- 172.21.15.7:0/3244915227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ba4004d30 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.444+0000 7f9bae000640 1 -- 172.21.15.7:0/3244915227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4031b00 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.444+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb01a0530 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 Processor -- start 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 -- start start 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bae000640 1 -- 172.21.15.7:0/3244915227 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f9ba4003cb0 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701863ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x557018643f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x5570186469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570185a8ab0 con 0x55701863eb30 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570185a6240 con 0x557018644500 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bbae64740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570185a1b30 con 0x55701863f470 2024-09-13T18:17:08.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701863ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701863ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56094/0 (socket says 172.21.15.7:56094) 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.447+0000 7f9bb6000640 1 -- 172.21.15.7:0/464317359 learned_addr learned my addr 172.21.15.7:0/464317359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb5600640 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x557018643f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x5570186469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb6000640 1 -- 172.21.15.7:0/464317359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 msgr2=0x557018643f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb6000640 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x557018643f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb6000640 1 -- 172.21.15.7:0/464317359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 msgr2=0x5570186469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb6000640 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x5570186469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb6000640 1 -- 172.21.15.7:0/464317359 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55701856cbd0 con 0x55701863eb30 2024-09-13T18:17:08.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9bb6000640 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701863ef30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009fd0 tx=0x7f9ba80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e14b87bac65dce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9ba2a00640 1 -- 172.21.15.7:0/464317359 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8004d20 con 0x55701863eb30 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9ba2a00640 1 -- 172.21.15.7:0/464317359 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ba8004e80 con 0x55701863eb30 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.448+0000 7f9ba2a00640 1 -- 172.21.15.7:0/464317359 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8005020 con 0x55701863eb30 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bae000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9b980a1090 0x7f9b980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bb5600640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9b980a1090 0x7f9b980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bae000640 1 -- 172.21.15.7:0/3244915227 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9ba40ed950 con 0x7f9bb00ffdc0 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bbae64740 1 -- 172.21.15.7:0/464317359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 msgr2=0x55701863ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bbae64740 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701863ef30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009fd0 tx=0x7f9ba80118d0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bbae64740 1 -- 172.21.15.7:0/464317359 shutdown_connections 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bbae64740 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x5570186469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bbae64740 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x557018643f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bbae64740 1 --2- 172.21.15.7:0/464317359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701863ef30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.449+0000 7f9bbae64740 1 -- 172.21.15.7:0/464317359 >> 172.21.15.7:0/464317359 conn(0x55701863a1a0 msgr2=0x55701863a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.450+0000 7f9bbae64740 1 -- 172.21.15.7:0/464317359 shutdown_connections 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.450+0000 7f9bb5600640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9b980a1090 0x7f9b980a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40eb440 tx=0x7f9ba40f33f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.450+0000 7f9bbae64740 1 -- 172.21.15.7:0/464317359 wait complete. 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.450+0000 7f9bbae64740 1 -- start start 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.450+0000 7f9bbae64740 1 Processor -- start 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x557018648740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863f470 0x557018648c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bbae64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x557018543260 con 0x55701863f470 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bbae64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x557018542f00 con 0x557018644500 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bbae64740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557018308f20 con 0x55701863eb30 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bbae64740 10 client.0 _ll_register_callbacks cb 0x55701859b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863f470 0x557018648c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb6000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x557018648740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863f470 0x557018648c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56106/0 (socket says 172.21.15.7:56106) 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 -- 172.21.15.7:0/149180120 learned_addr learned my addr 172.21.15.7:0/149180120 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb6000640 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 -- 172.21.15.7:0/149180120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 msgr2=0x557018648740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x557018648740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 -- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 msgr2=0x55701864fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb4c00640 1 -- 172.21.15.7:0/149180120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba8009c80 con 0x55701863f470 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.451+0000 7f9bb6000640 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863f470 0x557018648c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00bec0 tx=0x7f9b9c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec73a05d847ff834 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9b97400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9b97400640 1 -- 172.21.15.7:0/149180120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c012650 con 0x55701863f470 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9b97400640 1 -- 172.21.15.7:0/149180120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9b9c0127b0 con 0x55701863f470 2024-09-13T18:17:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570182953c0 con 0x55701863f470 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9b97400640 1 -- 172.21.15.7:0/149180120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b9c012970 con 0x55701863f470 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9bbae64740 10 client.15144 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5570185a01b0 con 0x55701863f470 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9b97400640 1 -- 172.21.15.7:0/149180120 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5570182953c0 con 0x55701863f470 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.452+0000 7f9b97400640 1 -- 172.21.15.7:0/149180120 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9b9c01bd10 con 0x55701863f470 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bbae64740 10 client.15144 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bbae64740 10 client.15144 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bbae64740 20 client.15144 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bbae64740 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557018654bc0 0x557018658d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bbae64740 4 client.15144 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 --> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570182a66c0 con 0x557018654bc0 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bb6000640 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557018654bc0 0x557018658d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9bb6000640 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557018654bc0 0x557018658d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=354b7d5508f67a3 server_cookie=db040ebce2ba6ac7 in_seq=0 out_seq=0 2024-09-13T18:17:08.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.453+0000 7f9b97400640 10 client.15144 ms_handle_connect on v2:172.21.15.67:6836/2829823752 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9b97400640 1 -- 172.21.15.7:0/149180120 <== mds.3 v2:172.21.15.67:6836/2829823752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5570182a66c0 con 0x557018654bc0 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9b97400640 10 client.15144 handle_command_reply: tid=0 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 client.15144 shutdown 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863f470 msgr2=0x557018648c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863f470 0x557018648c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00bec0 tx=0x7f9b9c0117b0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 shutdown_connections 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x557018654bc0 0x557018658d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863f470 0x557018648c80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 --2- 172.21.15.7:0/149180120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x557018648740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 >> 172.21.15.7:0/149180120 conn(0x55701863a1a0 msgr2=0x55701863b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.454+0000 7f9b97400640 0 client.15144 ms_handle_reset on v2:172.21.15.67:6836/2829823752 2024-09-13T18:17:08.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.455+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 shutdown_connections 2024-09-13T18:17:08.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.455+0000 7f9bbae64740 1 -- 172.21.15.7:0/149180120 wait complete. 2024-09-13T18:17:08.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.455+0000 7f9bbae64740 20 client.15144 trim_cache size 0 max 16384 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 Processor -- start 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 -- start start 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x55701863ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55701863f470 0x55701864fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557018644500 0x557018647c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570182a66c0 con 0x557018644500 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570182953c0 con 0x55701863f470 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bbae64740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55701859a8d0 con 0x55701863eb30 2024-09-13T18:17:08.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.470+0000 7f9bb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557018644500 0x557018647c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557018644500 0x557018647c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56110/0 (socket says 172.21.15.7:56110) 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 -- 172.21.15.7:0/4188612246 learned_addr learned my addr 172.21.15.7:0/4188612246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x55701863ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55701863f470 0x55701864fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 -- 172.21.15.7:0/4188612246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 msgr2=0x55701863ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x55701863ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 -- 172.21.15.7:0/4188612246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55701863f470 msgr2=0x55701864fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55701863f470 0x55701864fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 -- 172.21.15.7:0/4188612246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557018542470 con 0x557018644500 2024-09-13T18:17:08.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9bb6000640 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557018644500 0x557018647c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005c40 tx=0x7f9ba8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b293efa652683dff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9ba3400640 1 -- 172.21.15.7:0/4188612246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8033070 con 0x557018644500 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9ba3400640 1 -- 172.21.15.7:0/4188612246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ba8034040 con 0x557018644500 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.471+0000 7f9ba3400640 1 -- 172.21.15.7:0/4188612246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba802e540 con 0x557018644500 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 -- 172.21.15.7:0/4188612246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557018644500 msgr2=0x557018647c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557018644500 0x557018647c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005c40 tx=0x7f9ba8005fd0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 -- 172.21.15.7:0/4188612246 shutdown_connections 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557018644500 0x557018647c30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55701863f470 0x55701864fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 --2- 172.21.15.7:0/4188612246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863eb30 0x55701863ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 -- 172.21.15.7:0/4188612246 >> 172.21.15.7:0/4188612246 conn(0x55701863a1a0 msgr2=0x5570186468e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 -- 172.21.15.7:0/4188612246 shutdown_connections 2024-09-13T18:17:08.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 -- 172.21.15.7:0/4188612246 wait complete. 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.472+0000 7f9bbae64740 1 -- start start 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 1 Processor -- start 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701864a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x55701864fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55701864b0c0 con 0x55701863eb30 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570186aa9e0 con 0x557018644500 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570186aab20 con 0x55701863f470 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bbae64740 10 client.0 _ll_register_callbacks cb 0x7f9b9c00b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701864a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bb6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701864a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56118/0 (socket says 172.21.15.7:56118) 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bb6000640 1 -- 172.21.15.7:0/3053884559 learned_addr learned my addr 172.21.15.7:0/3053884559 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x55701864fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.473+0000 7f9bb6000640 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bb6000640 1 -- 172.21.15.7:0/3053884559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 msgr2=0x55701864fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bb6000640 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x55701864fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bb6000640 1 -- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 msgr2=0x55701864aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bb6000640 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bb6000640 1 -- 172.21.15.7:0/3053884559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55701856cbd0 con 0x55701863eb30 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bb6000640 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701864a570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8011f20 tx=0x7f9ba8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f43947b1eb80b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9b97400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9b97400640 1 -- 172.21.15.7:0/3053884559 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8033040 con 0x55701863eb30 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9b97400640 1 -- 172.21.15.7:0/3053884559 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9ba8003cb0 con 0x55701863eb30 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570185cbcd0 con 0x55701863eb30 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9b97400640 1 -- 172.21.15.7:0/3053884559 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba800f4e0 con 0x55701863eb30 2024-09-13T18:17:08.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bbae64740 10 client.15150 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.474+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557018567980 con 0x55701863eb30 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9b97400640 1 -- 172.21.15.7:0/3053884559 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5570185cbcd0 con 0x55701863eb30 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9b97400640 1 -- 172.21.15.7:0/3053884559 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9ba803c580 con 0x55701863eb30 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9bbae64740 10 client.15150 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9bbae64740 10 client.15150 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9bbae64740 20 client.15150 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9bbae64740 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x5570186af470 0x5570186abde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9bbae64740 4 client.15150 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 --> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5570182f9d10 con 0x5570186af470 2024-09-13T18:17:08.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.475+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x5570186af470 0x5570186abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.476+0000 7f9bb4c00640 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x5570186af470 0x5570186abde0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=621203ed11391659 server_cookie=d2862d0c03d991e7 in_seq=0 out_seq=0 2024-09-13T18:17:08.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.476+0000 7f9b97400640 10 client.15150 ms_handle_connect on v2:172.21.15.67:6836/2829823752 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.476+0000 7f9b97400640 1 -- 172.21.15.7:0/3053884559 <== mds.3 v2:172.21.15.67:6836/2829823752 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5570182f9d10 con 0x5570186af470 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.476+0000 7f9b97400640 10 client.15150 handle_command_reply: tid=0 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.476+0000 7f9bbae64740 1 client.15150 shutdown 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 msgr2=0x55701864a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701864a570 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8011f20 tx=0x7f9ba8000f40 comp rx=0 tx=0).stop 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 shutdown_connections 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:6836/2829823752,v1:172.21.15.67:6837/2829823752] conn(0x5570186af470 0x5570186abde0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557018644500 0x55701864aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55701863f470 0x55701864fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 --2- 172.21.15.7:0/3053884559 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55701863eb30 0x55701864a570 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9b97400640 0 client.15150 ms_handle_reset on v2:172.21.15.67:6836/2829823752 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 >> 172.21.15.7:0/3053884559 conn(0x55701863a1a0 msgr2=0x55701865cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 shutdown_connections 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 1 -- 172.21.15.7:0/3053884559 wait complete. 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bbae64740 20 client.15150 trim_cache size 0 max 16384 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24533, 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:17:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 117.432064314, 2024-09-13T18:17:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:17:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:17:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:17:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 138.33858423800001 2024-09-13T18:17:08.486 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:17:08.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.477+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9b980a1090 msgr2=0x7f9b980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9b980a1090 0x7f9b980a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40eb440 tx=0x7f9ba40f33f0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb00ffdc0 msgr2=0x7f9bb0074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb0074260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009230 tx=0x7f9ba40055a0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 shutdown_connections 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f9b980a1090 0x7f9b980a3550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb0101970 0x7f9bb0072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9bb0100fb0 0x7f9bb00728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 --2- 172.21.15.7:0/3244915227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9bb00ffdc0 0x7f9bb0074260 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 >> 172.21.15.7:0/3244915227 conn(0x7f9bb00fb520 msgr2=0x7f9bb0104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 shutdown_connections 2024-09-13T18:17:08.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.478+0000 7f9bb8000640 1 -- 172.21.15.7:0/3244915227 wait complete. 2024-09-13T18:17:08.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:17:08.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 -- 172.21.15.7:0/781325934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79840ffdc0 msgr2=0x7f79841001c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 --2- 172.21.15.7:0/781325934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79840ffdc0 0x7f79841001c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7978009900 tx=0x7f797802a410 comp rx=0 tx=0).stop 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 -- 172.21.15.7:0/781325934 shutdown_connections 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 --2- 172.21.15.7:0/781325934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7984101970 0x7f7984108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 --2- 172.21.15.7:0/781325934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7984100fb0 0x7f7984101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 --2- 172.21.15.7:0/781325934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79840ffdc0 0x7f79841001c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 -- 172.21.15.7:0/781325934 >> 172.21.15.7:0/781325934 conn(0x7f79840fb520 msgr2=0x7f79840fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 -- 172.21.15.7:0/781325934 shutdown_connections 2024-09-13T18:17:08.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.653+0000 7f798b600640 1 -- 172.21.15.7:0/781325934 wait complete. 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.654+0000 7f798b600640 1 Processor -- start 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.654+0000 7f798b600640 1 -- start start 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.654+0000 7f798b600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79840ffdc0 0x7f7984197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.654+0000 7f798b600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7984100fb0 0x7f79841984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f798b600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7984101970 0x7f798419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f798b600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798419fa80 con 0x7f7984100fb0 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f798b600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798419fbf0 con 0x7f7984101970 2024-09-13T18:17:08.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f798b600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798419fdb0 con 0x7f79840ffdc0 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7984100fb0 0x7f79841984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7984100fb0 0x7f79841984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56148/0 (socket says 172.21.15.7:56148) 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 -- 172.21.15.7:0/3791007508 learned_addr learned my addr 172.21.15.7:0/3791007508 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7988c00640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79840ffdc0 0x7f7984197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7989600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7984101970 0x7f798419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 -- 172.21.15.7:0/3791007508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79840ffdc0 msgr2=0x7f7984197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79840ffdc0 0x7f7984197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 -- 172.21.15.7:0/3791007508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7984101970 msgr2=0x7f798419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7984101970 0x7f798419f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 -- 172.21.15.7:0/3791007508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978009560 con 0x7f7984100fb0 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7989600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7984101970 0x7f798419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.655+0000 7f7983e00640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7984100fb0 0x7f79841984d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f797000e9f0 tx=0x7f797000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.656+0000 7f7981600640 1 -- 172.21.15.7:0/3791007508 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970009700 con 0x7f7984100fb0 2024-09-13T18:17:08.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.656+0000 7f7981600640 1 -- 172.21.15.7:0/3791007508 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f797000cd80 con 0x7f7984100fb0 2024-09-13T18:17:08.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.656+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79841a0090 con 0x7f7984100fb0 2024-09-13T18:17:08.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.656+0000 7f7981600640 1 -- 172.21.15.7:0/3791007508 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970018860 con 0x7f7984100fb0 2024-09-13T18:17:08.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.656+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79841a05a0 con 0x7f7984100fb0 2024-09-13T18:17:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 Processor -- start 2024-09-13T18:17:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 -- start start 2024-09-13T18:17:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f7981600640 1 -- 172.21.15.7:0/3791007508 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f79700189c0 con 0x7f7984100fb0 2024-09-13T18:17:08.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abf1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abf49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ab56ab0 con 0x56072abecb30 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ab54240 con 0x56072abed470 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f798e448740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ab4fb30 con 0x56072abf2500 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f7989600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f7989600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56152/0 (socket says 172.21.15.7:56152) 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f7989600640 1 -- 172.21.15.7:0/2147058417 learned_addr learned my addr 172.21.15.7:0/2147058417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f7988c00640 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abf1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.659+0000 7f7983e00640 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abf49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7989600640 1 -- 172.21.15.7:0/2147058417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 msgr2=0x56072abf49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7989600640 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abf49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7989600640 1 -- 172.21.15.7:0/2147058417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 msgr2=0x56072abf1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7989600640 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abf1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7989600640 1 -- 172.21.15.7:0/2147058417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56072ab1abd0 con 0x56072abecb30 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7989600640 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abecf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f797c009f10 tx=0x7f797c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90aea933b314a356 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7976000640 1 -- 172.21.15.7:0/2147058417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c004d20 con 0x56072abecb30 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7976000640 1 -- 172.21.15.7:0/2147058417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f797c004e80 con 0x56072abecb30 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7976000640 1 -- 172.21.15.7:0/2147058417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011810 con 0x56072abecb30 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.660+0000 7f7981600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f796c0a1090 0x7f796c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f7981600640 1 -- 172.21.15.7:0/3791007508 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7970014070 con 0x7f7984100fb0 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f7988c00640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f796c0a1090 0x7f796c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 -- 172.21.15.7:0/2147058417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 msgr2=0x56072abecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abecf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f797c009f10 tx=0x7f797c00e6c0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 -- 172.21.15.7:0/2147058417 shutdown_connections 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abf49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abf1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 --2- 172.21.15.7:0/2147058417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abecf30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 -- 172.21.15.7:0/2147058417 >> 172.21.15.7:0/2147058417 conn(0x56072abe81a0 msgr2=0x56072abe85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 -- 172.21.15.7:0/2147058417 shutdown_connections 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f798e448740 1 -- 172.21.15.7:0/2147058417 wait complete. 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.661+0000 7f7988c00640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f796c0a1090 0x7f796c0a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7978005ab0 tx=0x7f79780314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 -- start start 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 Processor -- start 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abf6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abfdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072aaf1260 con 0x56072abf2500 2024-09-13T18:17:08.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072aaf0f00 con 0x56072abecb30 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a8b6f20 con 0x56072abed470 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.662+0000 7f798e448740 10 client.0 _ll_register_callbacks cb 0x56072ab491a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:48982/0 (socket says 172.21.15.7:48982) 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 -- 172.21.15.7:0/939808346 learned_addr learned my addr 172.21.15.7:0/939808346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7989600640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abfdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7983e00640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abf6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 -- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 msgr2=0x56072abf6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abf6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 -- 172.21.15.7:0/939808346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 msgr2=0x56072abfdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abfdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 -- 172.21.15.7:0/939808346 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c009b40 con 0x56072abecb30 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7989600640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abfdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:08.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f7988c00640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf66f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7978033000 tx=0x7f7978009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8af4ecf7803b0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.663+0000 7f796aa00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-13T18:17:08.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f796aa00640 1 -- 172.21.15.7:0/939808346 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978004ad0 con 0x56072abecb30 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f796aa00640 1 -- 172.21.15.7:0/939808346 <== mon.2 v2:172.21.15.67:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7978004c30 con 0x56072abecb30 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56072a8433c0 con 0x56072abecb30 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f796aa00640 1 -- 172.21.15.7:0/939808346 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7978004df0 con 0x56072abecb30 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f798e448740 10 client.25220 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56072ab4e1b0 con 0x56072abecb30 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f796aa00640 1 -- 172.21.15.7:0/939808346 <== mon.2 v2:172.21.15.67:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56072a8433c0 con 0x56072abecb30 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f796aa00640 1 -- 172.21.15.7:0/939808346 <== mon.2 v2:172.21.15.67:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f797805b070 con 0x56072abecb30 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f798e448740 10 client.25220 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.664+0000 7f798e448740 10 client.25220 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.665+0000 7f798e448740 20 client.25220 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.665+0000 7f798e448740 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac024b0 0x56072ac06c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.665+0000 7f798e448740 4 client.25220 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.665+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 --> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56072a8546c0 con 0x56072ac024b0 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.665+0000 7f7983e00640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac024b0 0x56072ac06c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.665+0000 7f7983e00640 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac024b0 0x56072ac06c20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19749f33092d7981 server_cookie=2f68a90042c0251 in_seq=0 out_seq=0 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.665+0000 7f796aa00640 10 client.25220 ms_handle_connect on v2:172.21.15.116:6836/1196913954 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f796aa00640 1 -- 172.21.15.7:0/939808346 <== mds.2 v2:172.21.15.116:6836/1196913954 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56072a8546c0 con 0x56072ac024b0 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f796aa00640 10 client.25220 handle_command_reply: tid=0 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 client.25220 shutdown 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 msgr2=0x56072abf66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf66f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7978033000 tx=0x7f7978009260 comp rx=0 tx=0).stop 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 shutdown_connections 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac024b0 0x56072ac06c20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abfdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abf6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 --2- 172.21.15.7:0/939808346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf66f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 >> 172.21.15.7:0/939808346 conn(0x56072abe81a0 msgr2=0x56072abe99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f796aa00640 0 client.25220 ms_handle_reset on v2:172.21.15.116:6836/1196913954 2024-09-13T18:17:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.666+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 shutdown_connections 2024-09-13T18:17:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.667+0000 7f798e448740 1 -- 172.21.15.7:0/939808346 wait complete. 2024-09-13T18:17:08.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.667+0000 7f798e448740 20 client.25220 trim_cache size 0 max 16384 2024-09-13T18:17:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 Processor -- start 2024-09-13T18:17:08.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 -- start start 2024-09-13T18:17:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abfdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abf69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ac04840 con 0x56072abf2500 2024-09-13T18:17:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ac04350 con 0x56072abecb30 2024-09-13T18:17:08.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.682+0000 7f798e448740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a8433c0 con 0x56072abed470 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abf69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7988c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7983e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abfdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abf69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56168/0 (socket says 172.21.15.7:56168) 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 -- 172.21.15.7:0/3322757074 learned_addr learned my addr 172.21.15.7:0/3322757074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 -- 172.21.15.7:0/3322757074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 msgr2=0x56072abfdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 --2- 172.21.15.7:0/3322757074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abfdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 -- 172.21.15.7:0/3322757074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 msgr2=0x56072abf64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 --2- 172.21.15.7:0/3322757074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 -- 172.21.15.7:0/3322757074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56072aaf0470 con 0x56072abf2500 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.683+0000 7f7989600640 1 --2- 172.21.15.7:0/3322757074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abf69e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f797c00ebc0 tx=0x7f797c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9f400d57d2e13f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f7976a00640 1 -- 172.21.15.7:0/3322757074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011730 con 0x56072abf2500 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f7976a00640 1 -- 172.21.15.7:0/3322757074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f797c022040 con 0x56072abf2500 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f7976a00640 1 -- 172.21.15.7:0/3322757074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c01ac60 con 0x56072abf2500 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 -- 172.21.15.7:0/3322757074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 msgr2=0x56072abf69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 --2- 172.21.15.7:0/3322757074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abf69e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f797c00ebc0 tx=0x7f797c00eef0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 -- 172.21.15.7:0/3322757074 shutdown_connections 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 --2- 172.21.15.7:0/3322757074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abf2500 0x56072abf69e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 --2- 172.21.15.7:0/3322757074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abed470 0x56072abfdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 --2- 172.21.15.7:0/3322757074 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abecb30 0x56072abf64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 -- 172.21.15.7:0/3322757074 >> 172.21.15.7:0/3322757074 conn(0x56072abe81a0 msgr2=0x56072abe3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 -- 172.21.15.7:0/3322757074 shutdown_connections 2024-09-13T18:17:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.684+0000 7f798e448740 1 -- 172.21.15.7:0/3322757074 wait complete. 2024-09-13T18:17:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 -- start start 2024-09-13T18:17:08.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 Processor -- start 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abfdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abfa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abfae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ac588e0 con 0x56072abecb30 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ac58a20 con 0x56072abed470 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072ac58b60 con 0x56072abf2500 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f798e448740 10 client.0 _ll_register_callbacks cb 0x7f7978005000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f7988c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abfdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f7988c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abfdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56170/0 (socket says 172.21.15.7:56170) 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f7988c00640 1 -- 172.21.15.7:0/925035648 learned_addr learned my addr 172.21.15.7:0/925035648 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.685+0000 7f7983e00640 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abfa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f7989600640 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abfae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f7988c00640 1 -- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 msgr2=0x56072abfae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f7988c00640 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abfae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f7988c00640 1 -- 172.21.15.7:0/925035648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 msgr2=0x56072abfa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f7988c00640 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abfa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f7988c00640 1 -- 172.21.15.7:0/925035648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56072ab1abd0 con 0x56072abecb30 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f7988c00640 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abfdc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f797802aa00 tx=0x7f7978004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14244f54674a48b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f796aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f796aa00640 1 -- 172.21.15.7:0/925035648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978004ce0 con 0x56072abecb30 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f796aa00640 1 -- 172.21.15.7:0/925035648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f79780035f0 con 0x56072abecb30 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.686+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56072ab79cd0 con 0x56072abecb30 2024-09-13T18:17:08.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f796aa00640 1 -- 172.21.15.7:0/925035648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7978004e40 con 0x56072abecb30 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 10 client.15168 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56072ab15980 con 0x56072abecb30 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f796aa00640 1 -- 172.21.15.7:0/925035648 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56072ab79cd0 con 0x56072abecb30 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f796aa00640 1 -- 172.21.15.7:0/925035648 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f797805b040 con 0x56072abecb30 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 10 client.15168 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 10 client.15168 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 20 client.15168 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac5d6e0 0x56072ac5a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 4 client.15168 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.687+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 --> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56072a8a7d10 con 0x56072ac5d6e0 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.688+0000 7f7983e00640 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac5d6e0 0x56072ac5a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.688+0000 7f7983e00640 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac5d6e0 0x56072ac5a010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b22e658e3f640aa7 server_cookie=279d32e1e47b0743 in_seq=0 out_seq=0 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.688+0000 7f796aa00640 10 client.15168 ms_handle_connect on v2:172.21.15.116:6836/1196913954 2024-09-13T18:17:08.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.688+0000 7f796aa00640 1 -- 172.21.15.7:0/925035648 <== mds.2 v2:172.21.15.116:6836/1196913954 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56072a8a7d10 con 0x56072ac5d6e0 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.688+0000 7f796aa00640 10 client.15168 handle_command_reply: tid=0 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.688+0000 7f798e448740 1 client.15168 shutdown 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 msgr2=0x56072abfdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abfdc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f797802aa00 tx=0x7f7978004430 comp rx=0 tx=0).stop 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 shutdown_connections 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:6836/1196913954,v1:172.21.15.116:6837/1196913954] conn(0x56072ac5d6e0 0x56072ac5a010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56072abf2500 0x56072abfae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56072abed470 0x56072abfa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 --2- 172.21.15.7:0/925035648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56072abecb30 0x56072abfdc70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f796aa00640 0 client.15168 ms_handle_reset on v2:172.21.15.116:6836/1196913954 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 >> 172.21.15.7:0/925035648 conn(0x56072abe81a0 msgr2=0x56072ac0ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 shutdown_connections 2024-09-13T18:17:08.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 1 -- 172.21.15.7:0/925035648 wait complete. 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798e448740 20 client.15168 trim_cache size 0 max 16384 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24538, 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 118.656300587, 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:17:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:17:08.698 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:17:08.698 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 140.98741797100001 2024-09-13T18:17:08.698 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:17:08.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f796c0a1090 msgr2=0x7f796c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798b600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f796c0a1090 0x7f796c0a3550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7978005ab0 tx=0x7f79780314a0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7984100fb0 msgr2=0x7f79841984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.689+0000 7f798b600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7984100fb0 0x7f79841984d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f797000e9f0 tx=0x7f797000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 shutdown_connections 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f796c0a1090 0x7f796c0a3550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7984101970 0x7f798419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7984100fb0 0x7f79841984d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 --2- 172.21.15.7:0/3791007508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79840ffdc0 0x7f7984197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 >> 172.21.15.7:0/3791007508 conn(0x7f79840fb520 msgr2=0x7f79841067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 shutdown_connections 2024-09-13T18:17:08.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.690+0000 7f798b600640 1 -- 172.21.15.7:0/3791007508 wait complete. 2024-09-13T18:17:08.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T18:17:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 -- 172.21.15.7:0/2620893349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b040ffdc0 msgr2=0x7f4b041001c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 --2- 172.21.15.7:0/2620893349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b040ffdc0 0x7f4b041001c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009900 tx=0x7f4af802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 -- 172.21.15.7:0/2620893349 shutdown_connections 2024-09-13T18:17:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 --2- 172.21.15.7:0/2620893349 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b04101970 0x7f4b04108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 --2- 172.21.15.7:0/2620893349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b04100fb0 0x7f4b04101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 --2- 172.21.15.7:0/2620893349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b040ffdc0 0x7f4b041001c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 -- 172.21.15.7:0/2620893349 >> 172.21.15.7:0/2620893349 conn(0x7f4b040fb560 msgr2=0x7f4b040fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 -- 172.21.15.7:0/2620893349 shutdown_connections 2024-09-13T18:17:08.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.866+0000 7f4b0c600640 1 -- 172.21.15.7:0/2620893349 wait complete. 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 Processor -- start 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 -- start start 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b040ffdc0 0x7f4b04197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b04100fb0 0x7f4b041984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b04101970 0x7f4b0419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0419faa0 con 0x7f4b04101970 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0419fc10 con 0x7f4b040ffdc0 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.867+0000 7f4b0c600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0419fdd0 con 0x7f4b04100fb0 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b04101970 0x7f4b0419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b04101970 0x7f4b0419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56192/0 (socket says 172.21.15.7:56192) 2024-09-13T18:17:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 -- 172.21.15.7:0/1292077352 learned_addr learned my addr 172.21.15.7:0/1292077352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b09200640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b04100fb0 0x7f4b041984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b09c00640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b040ffdc0 0x7f4b04197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 -- 172.21.15.7:0/1292077352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b04100fb0 msgr2=0x7f4b041984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b04100fb0 0x7f4b041984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 -- 172.21.15.7:0/1292077352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b040ffdc0 msgr2=0x7f4b04197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b040ffdc0 0x7f4b04197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 -- 172.21.15.7:0/1292077352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8009560 con 0x7f4b04101970 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b0a600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b04101970 0x7f4b0419f560 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00eb10 tx=0x7f4afc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.868+0000 7f4b02000640 1 -- 172.21.15.7:0/1292077352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc004b20 con 0x7f4b04101970 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.869+0000 7f4b02000640 1 -- 172.21.15.7:0/1292077352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4afc004c80 con 0x7f4b04101970 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.869+0000 7f4b02000640 1 -- 172.21.15.7:0/1292077352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc010690 con 0x7f4b04101970 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.869+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b041a00b0 con 0x7f4b04101970 2024-09-13T18:17:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.869+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b041a0570 con 0x7f4b04101970 2024-09-13T18:17:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.871+0000 7f4b0f5cf740 1 Processor -- start 2024-09-13T18:17:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b02000640 1 -- 172.21.15.7:0/1292077352 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f4afc005020 con 0x7f4b04101970 2024-09-13T18:17:08.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b0f5cf740 1 -- start start 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a28f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a2df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d438992ab0 con 0x55d438a28b30 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d438990240 con 0x55d438a29470 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d43898bb30 con 0x55d438a2e500 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b09200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a28f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.872+0000 7f4b09200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a28f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56194/0 (socket says 172.21.15.7:56194) 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 -- 172.21.15.7:0/2611317762 learned_addr learned my addr 172.21.15.7:0/2611317762 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09c00640 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a2df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 -- 172.21.15.7:0/2611317762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 msgr2=0x55d438a309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 -- 172.21.15.7:0/2611317762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 msgr2=0x55d438a2df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a2df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 -- 172.21.15.7:0/2611317762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d438956bd0 con 0x55d438a28b30 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b02000640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aec0a1110 0x7f4aec0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09200640 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a28f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4af00135a0 tx=0x7f4af0009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d78dff4bf8c303d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b02000640 1 -- 172.21.15.7:0/1292077352 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4afc014070 con 0x7f4b04101970 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4b09c00640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aec0a1110 0x7f4aec0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.873+0000 7f4af6a00640 1 -- 172.21.15.7:0/2611317762 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0004050 con 0x55d438a28b30 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4af6a00640 1 -- 172.21.15.7:0/2611317762 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af00035f0 con 0x55d438a28b30 2024-09-13T18:17:08.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4af6a00640 1 -- 172.21.15.7:0/2611317762 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000f7c0 con 0x55d438a28b30 2024-09-13T18:17:08.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/2611317762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 msgr2=0x55d438a28f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a28f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4af00135a0 tx=0x7f4af0009850 comp rx=0 tx=0).stop 2024-09-13T18:17:08.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b09c00640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aec0a1110 0x7f4aec0a35d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4af8031500 tx=0x7f4af8005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/2611317762 shutdown_connections 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a2df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/2611317762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a28f30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/2611317762 >> 172.21.15.7:0/2611317762 conn(0x55d438a241a0 msgr2=0x55d438a245a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/2611317762 shutdown_connections 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.874+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/2611317762 wait complete. 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 -- start start 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 Processor -- start 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a32700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a32c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a39c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d43892d260 con 0x55d438a28b30 2024-09-13T18:17:08.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d43892cf00 con 0x55d438a29470 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.875+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4386f2f20 con 0x55d438a2e500 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b0f5cf740 10 client.0 _ll_register_callbacks cb 0x55d4389851a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a32700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a32700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56206/0 (socket says 172.21.15.7:56206) 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 -- 172.21.15.7:0/3733177045 learned_addr learned my addr 172.21.15.7:0/3733177045 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09200640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a32c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b0a600640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a39c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 -- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 msgr2=0x55d438a39c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a39c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 -- 172.21.15.7:0/3733177045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 msgr2=0x55d438a32c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a32c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 -- 172.21.15.7:0/3733177045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af0009d70 con 0x55d438a28b30 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b0a600640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a39c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:08.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4b09c00640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a32700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b04100e10 tx=0x7f4af8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d863c0f798a0d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.876+0000 7f4aeb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4aeb400640 1 -- 172.21.15.7:0/3733177045 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80319b0 con 0x55d438a28b30 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4aeb400640 1 -- 172.21.15.7:0/3733177045 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4af8031b10 con 0x55d438a28b30 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4389b5cd0 con 0x55d438a28b30 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4aeb400640 1 -- 172.21.15.7:0/3733177045 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af8031cd0 con 0x55d438a28b30 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4b0f5cf740 10 client.15180 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d43898a1b0 con 0x55d438a28b30 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4aeb400640 1 -- 172.21.15.7:0/3733177045 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d4389b5cd0 con 0x55d438a28b30 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4aeb400640 1 -- 172.21.15.7:0/3733177045 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4af805a070 con 0x55d438a28b30 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.877+0000 7f4b0f5cf740 10 client.15180 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.878+0000 7f4b0f5cf740 10 client.15180 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.878+0000 7f4b0f5cf740 20 client.15180 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.878+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a3ec20 0x55d438a42dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.878+0000 7f4b0f5cf740 4 client.15180 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:17:08.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.878+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 --> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d43867f3c0 con 0x55d438a3ec20 2024-09-13T18:17:08.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.878+0000 7f4b09200640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a3ec20 0x55d438a42dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.879+0000 7f4b09200640 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a3ec20 0x55d438a42dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24f9412e3c680a85 server_cookie=b07f5d0cb1710d58 in_seq=0 out_seq=0 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.879+0000 7f4aeb400640 10 client.15180 ms_handle_connect on v2:172.21.15.116:6838/284751360 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.879+0000 7f4aeb400640 1 -- 172.21.15.7:0/3733177045 <== mds.1 v2:172.21.15.116:6838/284751360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d43867f3c0 con 0x55d438a3ec20 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.879+0000 7f4aeb400640 10 client.15180 handle_command_reply: tid=0 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.879+0000 7f4b0f5cf740 1 client.15180 shutdown 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 msgr2=0x55d438a32700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a32700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b04100e10 tx=0x7f4af8009260 comp rx=0 tx=0).stop 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 shutdown_connections 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a3ec20 0x55d438a42dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a2e500 0x55d438a39c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a29470 0x55d438a32c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4aeb400640 0 client.15180 ms_handle_reset on v2:172.21.15.116:6838/284751360 2024-09-13T18:17:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/3733177045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a32700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 >> 172.21.15.7:0/3733177045 conn(0x55d438a241a0 msgr2=0x55d438a259b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 shutdown_connections 2024-09-13T18:17:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/3733177045 wait complete. 2024-09-13T18:17:08.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.880+0000 7f4b0f5cf740 20 client.15180 trim_cache size 0 max 16384 2024-09-13T18:17:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.895+0000 7f4b0f5cf740 1 Processor -- start 2024-09-13T18:17:08.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.895+0000 7f4b0f5cf740 1 -- start start 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.895+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a28b30 0x55d438a28f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.895+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a29470 0x55d438a39c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.895+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a32cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d438a338f0 con 0x55d438a29470 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4389848d0 con 0x55d438a2e500 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d438988790 con 0x55d438a28b30 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a29470 0x55d438a39c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a29470 0x55d438a39c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56208/0 (socket says 172.21.15.7:56208) 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 -- 172.21.15.7:0/1800819474 learned_addr learned my addr 172.21.15.7:0/1800819474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09c00640 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a28b30 0x55d438a28f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b0a600640 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a32cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 -- 172.21.15.7:0/1800819474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a28b30 msgr2=0x55d438a28f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a28b30 0x55d438a28f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 -- 172.21.15.7:0/1800819474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 msgr2=0x55d438a32cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a32cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 -- 172.21.15.7:0/1800819474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d43892c470 con 0x55d438a29470 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.896+0000 7f4b09200640 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a29470 0x55d438a39c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4af0016010 tx=0x7f4af0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bdf43c52e4fcec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4af7400640 1 -- 172.21.15.7:0/1800819474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0026040 con 0x55d438a29470 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4af7400640 1 -- 172.21.15.7:0/1800819474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af0028040 con 0x55d438a29470 2024-09-13T18:17:08.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4af7400640 1 -- 172.21.15.7:0/1800819474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0005350 con 0x55d438a29470 2024-09-13T18:17:08.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1800819474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a29470 msgr2=0x55d438a39c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a29470 0x55d438a39c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4af0016010 tx=0x7f4af0005850 comp rx=0 tx=0).stop 2024-09-13T18:17:08.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1800819474 shutdown_connections 2024-09-13T18:17:08.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a32cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a29470 0x55d438a39c40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1800819474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a28b30 0x55d438a28f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1800819474 >> 172.21.15.7:0/1800819474 conn(0x55d438a241a0 msgr2=0x55d438a46de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1800819474 shutdown_connections 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.897+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1800819474 wait complete. 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 -- start start 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 Processor -- start 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a34d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a29470 0x55d438a35270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a38290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d438a387d0 con 0x55d438a28b30 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d438a38940 con 0x55d438a2e500 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d438a38b00 con 0x55d438a29470 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b0f5cf740 10 client.0 _ll_register_callbacks cb 0x7f4af8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.898+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a34d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a34d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56214/0 (socket says 172.21.15.7:56214) 2024-09-13T18:17:08.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 -- 172.21.15.7:0/1380217778 learned_addr learned my addr 172.21.15.7:0/1380217778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b0a600640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09200640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a29470 0x55d438a35270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 -- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a29470 msgr2=0x55d438a35270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a29470 0x55d438a35270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 -- 172.21.15.7:0/1380217778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 msgr2=0x55d438a38290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a38290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 -- 172.21.15.7:0/1380217778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d438956bd0 con 0x55d438a28b30 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09200640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a29470 0x55d438a35270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b09c00640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a34d30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009230 tx=0x7f4af8005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc0683042f1b0fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4aeb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4aeb400640 1 -- 172.21.15.7:0/1380217778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af803dde0 con 0x55d438a28b30 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4aeb400640 1 -- 172.21.15.7:0/1380217778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4af80317b0 con 0x55d438a28b30 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.899+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4af00035f0 con 0x55d438a28b30 2024-09-13T18:17:08.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4aeb400640 1 -- 172.21.15.7:0/1380217778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af8031970 con 0x55d438a28b30 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 10 client.15186 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d438951980 con 0x55d438a28b30 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4aeb400640 1 -- 172.21.15.7:0/1380217778 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af00035f0 con 0x55d438a28b30 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4aeb400640 1 -- 172.21.15.7:0/1380217778 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4af805a040 con 0x55d438a28b30 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 10 client.15186 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 10 client.15186 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 20 client.15186 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a99f60 0x55d438a96a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 4 client.15186 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.900+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 --> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4386906c0 con 0x55d438a99f60 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.901+0000 7f4b09200640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a99f60 0x55d438a96a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.901+0000 7f4b09200640 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a99f60 0x55d438a96a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19ea8dc68459eb1d server_cookie=eaa5432fe52abeb3 in_seq=0 out_seq=0 2024-09-13T18:17:08.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.901+0000 7f4aeb400640 10 client.15186 ms_handle_connect on v2:172.21.15.116:6838/284751360 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.901+0000 7f4aeb400640 1 -- 172.21.15.7:0/1380217778 <== mds.1 v2:172.21.15.116:6838/284751360 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d4386906c0 con 0x55d438a99f60 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.901+0000 7f4aeb400640 10 client.15186 handle_command_reply: tid=0 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.901+0000 7f4b0f5cf740 1 client.15186 shutdown 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 msgr2=0x55d438a34d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a34d30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009230 tx=0x7f4af8005960 comp rx=0 tx=0).stop 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 shutdown_connections 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:6838/284751360,v1:172.21.15.116:6839/284751360] conn(0x55d438a99f60 0x55d438a96a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d438a2e500 0x55d438a38290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d438a29470 0x55d438a35270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4aeb400640 0 client.15186 ms_handle_reset on v2:172.21.15.116:6838/284751360 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 --2- 172.21.15.7:0/1380217778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d438a28b30 0x55d438a34d30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 >> 172.21.15.7:0/1380217778 conn(0x55d438a241a0 msgr2=0x55d438a47600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 shutdown_connections 2024-09-13T18:17:08.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 1 -- 172.21.15.7:0/1380217778 wait complete. 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0f5cf740 20 client.15186 trim_cache size 0 max 16384 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24559, 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 119.873879656, 2024-09-13T18:17:08.910 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:17:08.911 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:17:08.911 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:17:08.911 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 136.33554270100001 2024-09-13T18:17:08.911 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:17:08.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aec0a1110 msgr2=0x7f4aec0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.902+0000 7f4b0c600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aec0a1110 0x7f4aec0a35d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4af8031500 tx=0x7f4af8005780 comp rx=0 tx=0).stop 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b04101970 msgr2=0x7f4b0419f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b04101970 0x7f4b0419f560 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00eb10 tx=0x7f4afc00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 shutdown_connections 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4aec0a1110 0x7f4aec0a35d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b04101970 0x7f4b0419f560 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b04100fb0 0x7f4b041984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 --2- 172.21.15.7:0/1292077352 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b040ffdc0 0x7f4b04197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 >> 172.21.15.7:0/1292077352 conn(0x7f4b040fb560 msgr2=0x7f4b041067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 shutdown_connections 2024-09-13T18:17:08.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:08.903+0000 7f4b0c600640 1 -- 172.21.15.7:0/1292077352 wait complete. 2024-09-13T18:17:08.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:17:08.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:08 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1905796201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:08.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:08 smithi007 ceph-mon[30588]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 -- 172.21.15.7:0/3380551336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 msgr2=0x7fc8dc103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/3380551336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc103440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009900 tx=0x7fc8c402a410 comp rx=0 tx=0).stop 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 -- 172.21.15.7:0/3380551336 shutdown_connections 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/3380551336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8dc103980 0x7fc8dc10a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/3380551336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc103440 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/3380551336 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc101dd0 0x7fc8dc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 -- 172.21.15.7:0/3380551336 >> 172.21.15.7:0/3380551336 conn(0x7fc8dc0fd530 msgr2=0x7fc8dc0ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:09.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 -- 172.21.15.7:0/3380551336 shutdown_connections 2024-09-13T18:17:09.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.077+0000 7fc8dbe00640 1 -- 172.21.15.7:0/3380551336 wait complete. 2024-09-13T18:17:09.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.078+0000 7fc8dbe00640 1 Processor -- start 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.078+0000 7fc8dbe00640 1 -- start start 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8dbe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8dc101dd0 0x7fc8dc197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8dbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc103980 0x7fc8dc19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8dbe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19f8c0 con 0x7fc8dc102fc0 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8dbe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19fa30 con 0x7fc8dc103980 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8dbe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc19fbf0 con 0x7fc8dc101dd0 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8d3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8d3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56234/0 (socket says 172.21.15.7:56234) 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8d3e00640 1 -- 172.21.15.7:0/2412636652 learned_addr learned my addr 172.21.15.7:0/2412636652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8dc101dd0 0x7fc8dc197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8db400640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc103980 0x7fc8dc19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8d3e00640 1 -- 172.21.15.7:0/2412636652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8dc101dd0 msgr2=0x7fc8dc197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8dc101dd0 0x7fc8dc197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8d3e00640 1 -- 172.21.15.7:0/2412636652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc103980 msgr2=0x7fc8dc19f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.079+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc103980 0x7fc8dc19f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8d3e00640 1 -- 172.21.15.7:0/2412636652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4009560 con 0x7fc8dc102fc0 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8dc101dd0 0x7fc8dc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8db400640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc103980 0x7fc8dc19f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc198360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4031500 tx=0x7fc8c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8d3400640 1 -- 172.21.15.7:0/2412636652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4003e00 con 0x7fc8dc102fc0 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8d3400640 1 -- 172.21.15.7:0/2412636652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8c4031c70 con 0x7fc8dc102fc0 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc19fe70 con 0x7fc8dc102fc0 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8d3400640 1 -- 172.21.15.7:0/2412636652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c403bd80 con 0x7fc8dc102fc0 2024-09-13T18:17:09.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.080+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc1a0240 con 0x7fc8dc102fc0 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.084+0000 7fc8e49f8740 1 Processor -- start 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.084+0000 7fc8e49f8740 1 -- start start 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.084+0000 7fc8d3400640 1 -- 172.21.15.7:0/2412636652 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fc8c403b460 con 0x7fc8dc102fc0 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c44670 0x55ecf7c46b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7ba8ab0 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7ba6240 con 0x55ecf7c44670 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7ba1b30 con 0x55ecf7c3eca0 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c440a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56242/0 (socket says 172.21.15.7:56242) 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 -- 172.21.15.7:0/2604182441 learned_addr learned my addr 172.21.15.7:0/2604182441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8db400640 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c44670 0x55ecf7c46b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 -- 172.21.15.7:0/2604182441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 msgr2=0x55ecf7c3f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c3f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 -- 172.21.15.7:0/2604182441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c44670 msgr2=0x55ecf7c46b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c44670 0x55ecf7c46b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8daa00640 1 -- 172.21.15.7:0/2604182441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecf7b6cbd0 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.085+0000 7fc8db400640 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c3f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:17:09.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.086+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c440a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0114c0 tx=0x7fc8cc011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2ad2928c228987 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.086+0000 7fc8cbe00640 1 -- 172.21.15.7:0/2604182441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc004020 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.086+0000 7fc8cbe00640 1 -- 172.21.15.7:0/2604182441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8cc005020 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.086+0000 7fc8cbe00640 1 -- 172.21.15.7:0/2604182441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc004c10 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.086+0000 7fc8d3400640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8c00a1090 0x7fc8c00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.086+0000 7fc8d3400640 1 -- 172.21.15.7:0/2412636652 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc8c40ed1a0 con 0x7fc8dc102fc0 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.086+0000 7fc8db400640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8c00a1090 0x7fc8c00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2604182441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 msgr2=0x55ecf7c440a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c440a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0114c0 tx=0x7fc8cc011980 comp rx=0 tx=0).stop 2024-09-13T18:17:09.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2604182441 shutdown_connections 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c44670 0x55ecf7c46b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c440a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2604182441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c3f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2604182441 >> 172.21.15.7:0/2604182441 conn(0x55ecf7c3a310 msgr2=0x55ecf7c3a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2604182441 shutdown_connections 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2604182441 wait complete. 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8db400640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8c00a1090 0x7fc8c00a3550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4005fd0 tx=0x7fc8d40096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.087+0000 7fc8e49f8740 1 -- start start 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 1 Processor -- start 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c48e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c44670 0x55ecf7c4fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7b43260 con 0x55ecf7c44670 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7b42f00 con 0x55ecf7c3eca0 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7908f20 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8e49f8740 10 client.0 _ll_register_callbacks cb 0x55ecf7b9b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c44670 0x55ecf7c4fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c44670 0x55ecf7c4fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56258/0 (socket says 172.21.15.7:56258) 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8db400640 1 -- 172.21.15.7:0/2318162871 learned_addr learned my addr 172.21.15.7:0/2318162871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c48e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.088+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8db400640 1 -- 172.21.15.7:0/2318162871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3f5e0 msgr2=0x55ecf7c48e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8db400640 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c48e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8db400640 1 -- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3eca0 msgr2=0x55ecf7c488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8db400640 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8db400640 1 -- 172.21.15.7:0/2318162871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc009cc0 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8db400640 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c44670 0x55ecf7c4fe70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4011bb0 tx=0x7fc8d4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb55608eb71a9838 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8c8c00640 1 -- 172.21.15.7:0/2318162871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4016070 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8c8c00640 1 -- 172.21.15.7:0/2318162871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc8d401fe00 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.089+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecf7bcbcd0 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8c8c00640 1 -- 172.21.15.7:0/2318162871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8d4027410 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 10 client.15198 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ecf7ba01b0 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8c8c00640 1 -- 172.21.15.7:0/2318162871 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ecf7bcbcd0 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8c8c00640 1 -- 172.21.15.7:0/2318162871 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc8d401c690 con 0x55ecf7c44670 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 10 client.15198 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:09.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 10 client.15198 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:17:09.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 20 client.15198 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:09.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c548e0 0x55ecf7c59050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 4 client.15198 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:17:09.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.090+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 --> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ecf78953c0 con 0x55ecf7c548e0 2024-09-13T18:17:09.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.091+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c548e0 0x55ecf7c59050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.091+0000 7fc8daa00640 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c548e0 0x55ecf7c59050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac8f02e78fd60b9c server_cookie=aab3c0c2539bba5d in_seq=0 out_seq=0 2024-09-13T18:17:09.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.091+0000 7fc8c8c00640 10 client.15198 ms_handle_connect on v2:172.21.15.67:6838/2314229455 2024-09-13T18:17:09.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8c8c00640 1 -- 172.21.15.7:0/2318162871 <== mds.0 v2:172.21.15.67:6838/2314229455 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55ecf78953c0 con 0x55ecf7c548e0 2024-09-13T18:17:09.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8c8c00640 10 client.15198 handle_command_reply: tid=0 2024-09-13T18:17:09.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 client.15198 shutdown 2024-09-13T18:17:09.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c44670 msgr2=0x55ecf7c4fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c44670 0x55ecf7c4fe70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4011bb0 tx=0x7fc8d4004ab0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 shutdown_connections 2024-09-13T18:17:09.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c44670 0x55ecf7c4fe70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c548e0 0x55ecf7c59050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c48e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/2318162871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8c8c00640 0 client.15198 ms_handle_reset on v2:172.21.15.67:6838/2314229455 2024-09-13T18:17:09.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 >> 172.21.15.7:0/2318162871 conn(0x55ecf7c3a310 msgr2=0x55ecf7c39650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:09.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 shutdown_connections 2024-09-13T18:17:09.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.092+0000 7fc8e49f8740 1 -- 172.21.15.7:0/2318162871 wait complete. 2024-09-13T18:17:09.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.093+0000 7fc8e49f8740 20 client.15198 trim_cache size 0 max 16384 2024-09-13T18:17:09.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 Processor -- start 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 -- start start 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3a310 0x55ecf7c3f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf78953c0 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7bcbcd0 con 0x55ecf7c3a310 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7c36140 con 0x55ecf7c3eca0 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.108+0000 7fc8db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56266/0 (socket says 172.21.15.7:56266) 2024-09-13T18:17:09.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 -- 172.21.15.7:0/1569509269 learned_addr learned my addr 172.21.15.7:0/1569509269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8daa00640 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3a310 0x55ecf7c3f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 -- 172.21.15.7:0/1569509269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 msgr2=0x55ecf7c4fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 -- 172.21.15.7:0/1569509269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3a310 msgr2=0x55ecf7c3f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3a310 0x55ecf7c3f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 -- 172.21.15.7:0/1569509269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecf7b42470 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8db400640 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c486a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4011810 tx=0x7fc8d40107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b417cd6a3d1e1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8d0c00640 1 -- 172.21.15.7:0/1569509269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d401fe00 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8d0c00640 1 -- 172.21.15.7:0/1569509269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8d401cc10 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.109+0000 7fc8d0c00640 1 -- 172.21.15.7:0/1569509269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4027990 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1569509269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 msgr2=0x55ecf7c486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c486a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4011810 tx=0x7fc8d40107b0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1569509269 shutdown_connections 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7c486a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1569509269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3a310 0x55ecf7c3f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1569509269 >> 172.21.15.7:0/1569509269 conn(0x55ecf7c46dd0 msgr2=0x55ecf7c404a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1569509269 shutdown_connections 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1569509269 wait complete. 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.110+0000 7fc8e49f8740 1 -- start start 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 1 Processor -- start 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3a310 0x55ecf7c4cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7caad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7c50040 con 0x55ecf7c3a310 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7c501b0 con 0x55ecf7c3f5e0 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf7cab250 con 0x55ecf7c3eca0 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8e49f8740 10 client.0 _ll_register_callbacks cb 0x7fc8d4011a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3a310 0x55ecf7c4cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3a310 0x55ecf7c4cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56274/0 (socket says 172.21.15.7:56274) 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8daa00640 1 -- 172.21.15.7:0/1291923630 learned_addr learned my addr 172.21.15.7:0/1291923630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.111+0000 7fc8db400640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7caad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8daa00640 1 -- 172.21.15.7:0/1291923630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 msgr2=0x55ecf7c4d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8daa00640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8daa00640 1 -- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3f5e0 msgr2=0x55ecf7caad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8daa00640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7caad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8daa00640 1 -- 172.21.15.7:0/1291923630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ecf7ba01b0 con 0x55ecf7c3a310 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8db400640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7caad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8daa00640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3a310 0x55ecf7c4cae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0058c0 tx=0x7fc8cc0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b96d49ac898bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8c8c00640 1 -- 172.21.15.7:0/1291923630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc011040 con 0x55ecf7c3a310 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8c8c00640 1 -- 172.21.15.7:0/1291923630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc8cc0111a0 con 0x55ecf7c3a310 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8cc005020 con 0x55ecf7c3a310 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8c8c00640 1 -- 172.21.15.7:0/1291923630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8cc011360 con 0x55ecf7c3a310 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8e49f8740 10 client.15204 fetch_fsmap learned FSMap version 26 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.112+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ecf7b67980 con 0x55ecf7c3a310 2024-09-13T18:17:09.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8c8c00640 1 -- 172.21.15.7:0/1291923630 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8cc005020 con 0x55ecf7c3a310 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8c8c00640 1 -- 172.21.15.7:0/1291923630 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc8cc03b070 con 0x55ecf7c3a310 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8e49f8740 10 client.15204 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8e49f8740 10 client.15204 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8e49f8740 20 client.15204 populate_metadata read hostname 'smithi007' 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c44670 0x55ecf7cac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8e49f8740 4 client.15204 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 --> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ecf78a66c0 con 0x55ecf7c44670 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.113+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c44670 0x55ecf7cac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8d3e00640 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c44670 0x55ecf7cac8a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4457af85202b1825 server_cookie=66933ebaffacccd in_seq=0 out_seq=0 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8c8c00640 10 client.15204 ms_handle_connect on v2:172.21.15.67:6838/2314229455 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8c8c00640 1 -- 172.21.15.7:0/1291923630 <== mds.0 v2:172.21.15.67:6838/2314229455 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ecf78a66c0 con 0x55ecf7c44670 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8c8c00640 10 client.15204 handle_command_reply: tid=0 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 client.15204 shutdown 2024-09-13T18:17:09.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3a310 msgr2=0x55ecf7c4cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3a310 0x55ecf7c4cae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0058c0 tx=0x7fc8cc0056a0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 shutdown_connections 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ecf7c3f5e0 0x55ecf7caad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.67:6838/2314229455,v1:172.21.15.67:6839/2314229455] conn(0x55ecf7c44670 0x55ecf7cac8a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ecf7c3eca0 0x55ecf7c4d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 --2- 172.21.15.7:0/1291923630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ecf7c3a310 0x55ecf7c4cae0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8c8c00640 0 client.15204 ms_handle_reset on v2:172.21.15.67:6838/2314229455 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 >> 172.21.15.7:0/1291923630 conn(0x55ecf7c46dd0 msgr2=0x55ecf7c43690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 shutdown_connections 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.114+0000 7fc8e49f8740 1 -- 172.21.15.7:0/1291923630 wait complete. 2024-09-13T18:17:09.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8e49f8740 20 client.15204 trim_cache size 0 max 16384 2024-09-13T18:17:09.124 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:17:09.124 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "d9377e86-71fa-11ef-bceb-c7b262605968", 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24581, 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 123.11027158500001, 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 26, 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 127.68990268500001 2024-09-13T18:17:09.125 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:17:09.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8c00a1090 msgr2=0x7fc8c00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8c00a1090 0x7fc8c00a3550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4005fd0 tx=0x7fc8d40096a0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 msgr2=0x7fc8dc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc198360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4031500 tx=0x7fc8c4003c10 comp rx=0 tx=0).stop 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 shutdown_connections 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8c00a1090 0x7fc8c00a3550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8dc103980 0x7fc8dc19f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc8dc102fc0 0x7fc8dc198360 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 --2- 172.21.15.7:0/2412636652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8dc101dd0 0x7fc8dc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 >> 172.21.15.7:0/2412636652 conn(0x7fc8dc0fd530 msgr2=0x7fc8dc1064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 shutdown_connections 2024-09-13T18:17:09.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:09.115+0000 7fc8dbe00640 1 -- 172.21.15.7:0/2412636652 wait complete. 2024-09-13T18:17:09.134 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:17:09.143 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:17:09.143 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:17:09.144 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:17:09.144 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T18:17:09.238 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T18:17:09.238 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-13T18:17:09.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:09.238 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-13T18:17:09.239 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:08 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1905796201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:09.239 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:08 smithi116 ceph-mon[35109]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:17:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:08 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1905796201' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:17:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:08 smithi067 ceph-mon[35103]: pgmap v348: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:17:09.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:09.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-13T18:17:09.374 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-09-13T18:17:09.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:17:09.377 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-13T18:17:09.377 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:17:09.377 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:09.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T18:17:09.695 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:17:10.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:10 smithi116 ceph-mon[35109]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:10 smithi067 ceph-mon[35103]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:10 smithi007 ceph-mon[30588]: pgmap v349: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 -- 172.21.15.7:0/3240069173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c41029c0 msgr2=0x7f27c4106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 --2- 172.21.15.7:0/3240069173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c41029c0 0x7f27c4106a10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009930 tx=0x7f27b002a420 comp rx=0 tx=0).stop 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 -- 172.21.15.7:0/3240069173 shutdown_connections 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 --2- 172.21.15.7:0/3240069173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c4107140 0x7f27c410ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 --2- 172.21.15.7:0/3240069173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c41029c0 0x7f27c4106a10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 --2- 172.21.15.7:0/3240069173 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c4102010 0x7f27c41023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 -- 172.21.15.7:0/3240069173 >> 172.21.15.7:0/3240069173 conn(0x7f27c40fda70 msgr2=0x7f27c40ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 -- 172.21.15.7:0/3240069173 shutdown_connections 2024-09-13T18:17:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.761+0000 7f27c9400640 1 -- 172.21.15.7:0/3240069173 wait complete. 2024-09-13T18:17:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 Processor -- start 2024-09-13T18:17:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 -- start start 2024-09-13T18:17:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c4102010 0x7f27c41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c41029c0 0x7f27c4198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c4107140 0x7f27c419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c419d230 con 0x7f27c4107140 2024-09-13T18:17:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c419d3a0 con 0x7f27c41029c0 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c9400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c419d510 con 0x7f27c4102010 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.762+0000 7f27c8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c4107140 0x7f27c419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c4107140 0x7f27c419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56294/0 (socket says 172.21.15.7:56294) 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 -- 172.21.15.7:0/139114036 learned_addr learned my addr 172.21.15.7:0/139114036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c3400640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c41029c0 0x7f27c4198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c3e00640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c4102010 0x7f27c41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 -- 172.21.15.7:0/139114036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c4102010 msgr2=0x7f27c41982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c4102010 0x7f27c41982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 -- 172.21.15.7:0/139114036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c41029c0 msgr2=0x7f27c4198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c41029c0 0x7f27c4198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 -- 172.21.15.7:0/139114036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0009560 con 0x7f27c4107140 2024-09-13T18:17:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.763+0000 7f27c8a00640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c4107140 0x7f27c419cc30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00eb10 tx=0x7f27bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.764+0000 7f27c0c00640 1 -- 172.21.15.7:0/139114036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc004b20 con 0x7f27c4107140 2024-09-13T18:17:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.764+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c419d7f0 con 0x7f27c4107140 2024-09-13T18:17:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.764+0000 7f27c0c00640 1 -- 172.21.15.7:0/139114036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27bc004c80 con 0x7f27c4107140 2024-09-13T18:17:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.764+0000 7f27c0c00640 1 -- 172.21.15.7:0/139114036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc010690 con 0x7f27c4107140 2024-09-13T18:17:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.764+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c41a50b0 con 0x7f27c4107140 2024-09-13T18:17:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.765+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c41034f0 con 0x7f27c4107140 2024-09-13T18:17:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.767+0000 7f27c0c00640 1 -- 172.21.15.7:0/139114036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f27bc005020 con 0x7f27c4107140 2024-09-13T18:17:11.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.769+0000 7f27c0c00640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27a80a1070 0x7f27a80a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:11.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.769+0000 7f27c0c00640 1 -- 172.21.15.7:0/139114036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f27bc014070 con 0x7f27c4107140 2024-09-13T18:17:11.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.769+0000 7f27c3e00640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27a80a1070 0x7f27a80a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:11.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.770+0000 7f27c3e00640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27a80a1070 0x7f27a80a3530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009bd0 tx=0x7f27b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.773+0000 7f27c0c00640 1 -- 172.21.15.7:0/139114036 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f27bc096520 con 0x7f27c4107140 2024-09-13T18:17:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.992+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27c410a380 con 0x7f27c4107140 2024-09-13T18:17:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.992+0000 7f27c0c00640 1 -- 172.21.15.7:0/139114036 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27bc099b40 con 0x7f27c4107140 2024-09-13T18:17:11.996 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27a80a1070 msgr2=0x7f27a80a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27a80a1070 0x7f27a80a3530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009bd0 tx=0x7f27b4005f90 comp rx=0 tx=0).stop 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c4107140 msgr2=0x7f27c419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c4107140 0x7f27c419cc30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00eb10 tx=0x7f27bc00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 shutdown_connections 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f27a80a1070 0x7f27a80a3530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27c4107140 0x7f27c419cc30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27c41029c0 0x7f27c4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 --2- 172.21.15.7:0/139114036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c4102010 0x7f27c41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.995+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 >> 172.21.15.7:0/139114036 conn(0x7f27c40fda70 msgr2=0x7f27c40fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.996+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 shutdown_connections 2024-09-13T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:11.996+0000 7f27c9400640 1 -- 172.21.15.7:0/139114036 wait complete. 2024-09-13T18:17:12.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:12 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/139114036' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:17:12.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:12 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/139114036' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:17:12.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:12 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/139114036' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:17:12.785 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:17:12.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:12.786 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-13T18:17:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42142sec preferred_lft 42142sec 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T18:17:12.824 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-13T18:17:12.825 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:17:12.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:12.825 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T18:17:12.825 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T18:17:12.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:17:12.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-13T18:17:12.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-13T18:17:12.825 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:17:12.826 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T18:17:13.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:13.191 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:17:13.248 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-13T18:17:13.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:13.251 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-13T18:17:13.304 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-13T18:17:13.304 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:17:13.304 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:17:13.304 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:17:13.304 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:17:13.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:13.305 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T18:17:13.305 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T18:17:13.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:17:13.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:17:13.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:17:13.305 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T18:17:13.356 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:13 smithi007 ceph-mon[30588]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:13.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:13 smithi116 ceph-mon[35109]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:13.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:13 smithi067 ceph-mon[35103]: pgmap v350: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:13.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:13.871 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-13T18:17:13.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:13.908 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-13T18:17:13.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:13.984 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T18:17:13.984 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T18:17:13.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:17:13.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:17:13.984 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T18:17:14.115 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:17:14.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:17:14.116 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T18:17:14.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:14.340 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T18:17:14.340 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T18:17:14.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-13T18:17:14.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:17:14.341 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T18:17:14.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:17:14.459 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:14.494 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:17:14.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:17:14.495 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:14.570 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-13T18:17:14.570 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-13T18:17:14.571 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/8c32217c-01d8-47a4-a5da-f0fd99d5f9ac 2024-09-13T18:17:14.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:14.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/8c32217c-01d8-47a4-a5da-f0fd99d5f9ac /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-13T18:17:14.704 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-13T18:17:14.704 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-13T18:17:14.704 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-13T18:17:14.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:14 smithi007 ceph-mon[30588]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:14.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:14 smithi116 ceph-mon[35109]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:14 smithi067 ceph-mon[35103]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:15.355 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-13T18:17:15.356 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-13T18:17:15.356 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-13T18:17:15.356 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.67:3300,172.21.15.116:3300" 2024-09-13T18:17:15.356 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:3300,172.21.15.67:3300,172.21.15.116:3300:/volumes/qa/sv_1/8c32217c-01d8-47a4-a5da-f0fd99d5f9ac 2024-09-13T18:17:15.356 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=d9377e86-71fa-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T18:17:15.358 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:17:15.358 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:17:15.358 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:17:15.358 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:17:15.358 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:17:15.361 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:17:15.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:15.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:15.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:15.421 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:17:15.460 INFO:teuthology.orchestra.run.smithi007.stdout:client25285 2024-09-13T18:17:15.460 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:17:15.460 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:17:15.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:15.536 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:17:15.615 INFO:teuthology.orchestra.run.smithi007.stdout:client25285 2024-09-13T18:17:15.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:15.616 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:17:15.694 INFO:teuthology.orchestra.run.smithi007.stdout:client25285 2024-09-13T18:17:15.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:17:15.695 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d9377e86-71fa-11ef-bceb-c7b262605968.client25285/status') 2024-09-13T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.25285 (3)172.21.15.7:0/1571470038 2024-09-13T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-09-13T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-09-13T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-09-13T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:70 bytes copied, 6.1376e-05 s, 1.1 MB/s 2024-09-13T18:17:15.794 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T18:17:15.805 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T18:17:15.805 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T18:17:15.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-13T18:17:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 -- 172.21.15.7:0/3623837290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c076a50 msgr2=0x7f1a8c0772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3623837290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c076a50 0x7f1a8c0772f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009ca0 tx=0x7f1a8402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:17:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 -- 172.21.15.7:0/3623837290 shutdown_connections 2024-09-13T18:17:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3623837290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c076a50 0x7f1a8c0772f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3623837290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c0760b0 0x7f1a8c076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3623837290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a8c074e70 0x7f1a8c075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 -- 172.21.15.7:0/3623837290 >> 172.21.15.7:0/3623837290 conn(0x7f1a8c0fd4d0 msgr2=0x7f1a8c0ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 -- 172.21.15.7:0/3623837290 shutdown_connections 2024-09-13T18:17:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.957+0000 7f1a90a00640 1 -- 172.21.15.7:0/3623837290 wait complete. 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.958+0000 7f1a90a00640 1 Processor -- start 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.958+0000 7f1a90a00640 1 -- start start 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.958+0000 7f1a90a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c074e70 0x7f1a8c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a90a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a8c0760b0 0x7f1a8c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a90a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c076a50 0x7f1a8c1a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a90a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c1a3b60 con 0x7f1a8c074e70 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a90a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c1a3cd0 con 0x7f1a8c0760b0 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a90a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c1a3e90 con 0x7f1a8c076a50 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c074e70 0x7f1a8c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:15.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c074e70 0x7f1a8c19c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45108/0 (socket says 172.21.15.7:45108) 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 -- 172.21.15.7:0/3396493250 learned_addr learned my addr 172.21.15.7:0/3396493250 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a89e00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a8c0760b0 0x7f1a8c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8b200640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c076a50 0x7f1a8c1a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 -- 172.21.15.7:0/3396493250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c076a50 msgr2=0x7f1a8c1a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c076a50 0x7f1a8c1a3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 -- 172.21.15.7:0/3396493250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a8c0760b0 msgr2=0x7f1a8c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a8c0760b0 0x7f1a8c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.959+0000 7f1a8a800640 1 -- 172.21.15.7:0/3396493250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84009900 con 0x7f1a8c074e70 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.960+0000 7f1a8a800640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c074e70 0x7f1a8c19c070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00e9f0 tx=0x7f1a7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.960+0000 7f1a83400640 1 -- 172.21.15.7:0/3396493250 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c009700 con 0x7f1a8c074e70 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.960+0000 7f1a83400640 1 -- 172.21.15.7:0/3396493250 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a7c00cd80 con 0x7f1a8c074e70 2024-09-13T18:17:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.960+0000 7f1a83400640 1 -- 172.21.15.7:0/3396493250 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c018860 con 0x7f1a8c074e70 2024-09-13T18:17:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.960+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c1a4170 con 0x7f1a8c074e70 2024-09-13T18:17:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.960+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c1a4630 con 0x7f1a8c074e70 2024-09-13T18:17:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.961+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c10e6e0 con 0x7f1a8c074e70 2024-09-13T18:17:15.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.963+0000 7f1a83400640 1 -- 172.21.15.7:0/3396493250 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f1a7c0189c0 con 0x7f1a8c074e70 2024-09-13T18:17:15.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.964+0000 7f1a83400640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a700a11b0 0x7f1a700a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:15.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.964+0000 7f1a83400640 1 -- 172.21.15.7:0/3396493250 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1a7c014070 con 0x7f1a8c074e70 2024-09-13T18:17:15.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.964+0000 7f1a89e00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a700a11b0 0x7f1a700a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:15.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.965+0000 7f1a89e00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a700a11b0 0x7f1a700a3670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c19d580 tx=0x7f1a78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:15.968+0000 7f1a83400640 1 -- 172.21.15.7:0/3396493250 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1a7c052e20 con 0x7f1a8c074e70 2024-09-13T18:17:16.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.186+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f1a8c111ad0 con 0x7f1a8c074e70 2024-09-13T18:17:16.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.241+0000 7f1a83400640 1 -- 172.21.15.7:0/3396493250 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1a7c0963e0 con 0x7f1a8c074e70 2024-09-13T18:17:16.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a700a11b0 msgr2=0x7f1a700a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a700a11b0 0x7f1a700a3670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c19d580 tx=0x7f1a78005f90 comp rx=0 tx=0).stop 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c074e70 msgr2=0x7f1a8c19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c074e70 0x7f1a8c19c070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00e9f0 tx=0x7f1a7c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 shutdown_connections 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f1a700a11b0 0x7f1a700a3670 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a8c076a50 0x7f1a8c1a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a8c0760b0 0x7f1a8c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 --2- 172.21.15.7:0/3396493250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c074e70 0x7f1a8c19c070 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 >> 172.21.15.7:0/3396493250 conn(0x7f1a8c0fd4d0 msgr2=0x7f1a8c0fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 shutdown_connections 2024-09-13T18:17:16.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.243+0000 7f1a90a00640 1 -- 172.21.15.7:0/3396493250 wait complete. 2024-09-13T18:17:16.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 -- 172.21.15.7:0/3891085606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0102f60 msgr2=0x7fb2e01033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/3891085606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0102f60 0x7fb2e01033e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009860 tx=0x7fb2cc02a340 comp rx=0 tx=0).stop 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 -- 172.21.15.7:0/3891085606 shutdown_connections 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/3891085606 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e0103920 0x7fb2e010a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/3891085606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0102f60 0x7fb2e01033e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/3891085606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0101d70 0x7fb2e0102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 -- 172.21.15.7:0/3891085606 >> 172.21.15.7:0/3891085606 conn(0x7fb2e00fd4d0 msgr2=0x7fb2e00ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 -- 172.21.15.7:0/3891085606 shutdown_connections 2024-09-13T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.416+0000 7fb2e5a00640 1 -- 172.21.15.7:0/3891085606 wait complete. 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.417+0000 7fb2e5a00640 1 Processor -- start 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.417+0000 7fb2e5a00640 1 -- start start 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2e5a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0101d70 0x7fb2e0197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2e5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0102f60 0x7fb2e0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2e5a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e0103920 0x7fb2e019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2e5a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e019f7d0 con 0x7fb2e0102f60 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2e5a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e019f940 con 0x7fb2e0103920 2024-09-13T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2e5a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e019fb00 con 0x7fb2e0101d70 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2df400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0102f60 0x7fb2e0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2df400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0102f60 0x7fb2e0198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45114/0 (socket says 172.21.15.7:45114) 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2df400640 1 -- 172.21.15.7:0/1548011140 learned_addr learned my addr 172.21.15.7:0/1548011140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2dfe00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0101d70 0x7fb2e0197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2e5000640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e0103920 0x7fb2e019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2df400640 1 -- 172.21.15.7:0/1548011140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0101d70 msgr2=0x7fb2e0197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2df400640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0101d70 0x7fb2e0197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2df400640 1 -- 172.21.15.7:0/1548011140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e0103920 msgr2=0x7fb2e019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.418+0000 7fb2df400640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e0103920 0x7fb2e019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.419+0000 7fb2df400640 1 -- 172.21.15.7:0/1548011140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc009490 con 0x7fb2e0102f60 2024-09-13T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.419+0000 7fb2df400640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0102f60 0x7fb2e0198230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0304b0 tx=0x7fb2cc032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.419+0000 7fb2dcc00640 1 -- 172.21.15.7:0/1548011140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc032770 con 0x7fb2e0102f60 2024-09-13T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.419+0000 7fb2dcc00640 1 -- 172.21.15.7:0/1548011140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2cc004510 con 0x7fb2e0102f60 2024-09-13T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.419+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e019fd80 con 0x7fb2e0102f60 2024-09-13T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.419+0000 7fb2dcc00640 1 -- 172.21.15.7:0/1548011140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc004920 con 0x7fb2e0102f60 2024-09-13T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.419+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e01a0180 con 0x7fb2e0102f60 2024-09-13T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.421+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e0109200 con 0x7fb2e0102f60 2024-09-13T18:17:16.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.422+0000 7fb2dcc00640 1 -- 172.21.15.7:0/1548011140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fb2cc005170 con 0x7fb2e0102f60 2024-09-13T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.424+0000 7fb2dcc00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2c40a1130 0x7fb2c40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.424+0000 7fb2dcc00640 1 -- 172.21.15.7:0/1548011140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb2cc0ece60 con 0x7fb2e0102f60 2024-09-13T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.424+0000 7fb2dfe00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2c40a1130 0x7fb2c40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.424+0000 7fb2dfe00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2c40a1130 0x7fb2c40a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2e01991c0 tx=0x7fb2d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:17:16.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.428+0000 7fb2dcc00640 1 -- 172.21.15.7:0/1548011140 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb2cc0b6510 con 0x7fb2e0102f60 2024-09-13T18:17:16.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:16 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3396493250' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:17:16.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:16 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3396493250' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:17:16.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.634+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 --> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e002c550 con 0x7fb2c40a1130 2024-09-13T18:17:16.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.661+0000 7fb2dcc00640 1 -- 172.21.15.7:0/1548011140 <== mgr.14150 v2:172.21.15.7:6800/1436660417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fb2e002c550 con 0x7fb2c40a1130 2024-09-13T18:17:16.664 INFO:teuthology.orchestra.run.smithi007.stdout:{} 2024-09-13T18:17:16.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2c40a1130 msgr2=0x7fb2c40a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2c40a1130 0x7fb2c40a35f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2e01991c0 tx=0x7fb2d0009260 comp rx=0 tx=0).stop 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0102f60 msgr2=0x7fb2e0198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0102f60 0x7fb2e0198230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0304b0 tx=0x7fb2cc032d20 comp rx=0 tx=0).stop 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 shutdown_connections 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2c40a1130 0x7fb2c40a35f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2e0103920 0x7fb2e019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2e0102f60 0x7fb2e0198230 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 --2- 172.21.15.7:0/1548011140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2e0101d70 0x7fb2e0197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 >> 172.21.15.7:0/1548011140 conn(0x7fb2e00fd4d0 msgr2=0x7fb2e01063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 shutdown_connections 2024-09-13T18:17:16.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:17:16.663+0000 7fb2e5a00640 1 -- 172.21.15.7:0/1548011140 wait complete. 2024-09-13T18:17:16.683 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-13T18:17:16.694 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T18:17:16.708 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:17:16.708 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:17:16.708 INFO:tasks.workunit:timeout=3h 2024-09-13T18:17:16.709 INFO:tasks.workunit:cleanup=True 2024-09-13T18:17:16.709 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:16.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:16 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3396493250' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:17:16.745 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:16.745 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T18:17:16.745 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-13T18:17:16.745 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:17:16.745 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T18:17:16.746 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 18:15:12.711386216 +0000 2024-09-13T18:17:16.746 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 18:15:12.711386216 +0000 2024-09-13T18:17:16.746 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 18:17:15.413722744 +0000 2024-09-13T18:17:16.746 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 18:15:12.711386216 +0000 2024-09-13T18:17:16.746 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:17:16.746 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:17:16.853 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:17:16.892 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:17:17.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:17:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:17:16.640+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:17:17.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:17:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:17:16.640+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:17:17.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:17:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:17:16.640+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:17:17.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:17:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:17:16.640+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:17:17.041 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:17:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:17:16.640+0000 7fbb19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:17:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:17 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3396493250' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T18:17:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:17 smithi007 ceph-mon[30588]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:17:17.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:17 smithi007 ceph-mon[30588]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:17.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:17 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3396493250' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T18:17:17.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:17 smithi116 ceph-mon[35109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:17:17.713 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:17 smithi116 ceph-mon[35109]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:17.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:17 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3396493250' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T18:17:17.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:17 smithi067 ceph-mon[35103]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:17:17.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:17 smithi067 ceph-mon[35103]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:18.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:18 smithi007 ceph-mon[30588]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:17:18.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:18 smithi116 ceph-mon[35109]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:17:18.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:18 smithi067 ceph-mon[35103]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:17:19.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:19 smithi007 ceph-mon[30588]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-13T18:17:19.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:19 smithi116 ceph-mon[35109]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-13T18:17:19.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:19 smithi067 ceph-mon[35103]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-13T18:17:20.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:20 smithi007 ceph-mon[30588]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T18:17:20.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:20 smithi116 ceph-mon[35109]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T18:17:20.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:20 smithi067 ceph-mon[35103]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T18:17:21.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:21 smithi007 ceph-mon[30588]: pgmap v354: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T18:17:21.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:21 smithi116 ceph-mon[35109]: pgmap v354: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T18:17:21.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:21 smithi067 ceph-mon[35103]: pgmap v354: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-13T18:17:22.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:22 smithi116 ceph-mon[35109]: pgmap v355: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-13T18:17:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:22 smithi067 ceph-mon[35103]: pgmap v355: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-13T18:17:23.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:22 smithi007 ceph-mon[30588]: pgmap v355: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-09-13T18:17:24.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:24 smithi116 ceph-mon[35109]: pgmap v356: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-13T18:17:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:24 smithi067 ceph-mon[35103]: pgmap v356: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-13T18:17:25.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:24 smithi007 ceph-mon[30588]: pgmap v356: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-13T18:17:26.700 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:26 smithi007 ceph-mon[30588]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-13T18:17:26.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:26 smithi116 ceph-mon[35109]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-13T18:17:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:26 smithi067 ceph-mon[35103]: pgmap v357: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-13T18:17:28.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:28 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:17:28.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:28 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:17:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:28 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:17:29.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:29 smithi007 ceph-mon[30588]: pgmap v358: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-13T18:17:29.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:29 smithi116 ceph-mon[35109]: pgmap v358: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-13T18:17:29.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:29 smithi067 ceph-mon[35103]: pgmap v358: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-13T18:17:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:30 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:30 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:30 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:30 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:30 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:30 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:30 smithi116 ceph-mon[35109]: pgmap v359: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-13T18:17:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:30 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:30 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:30 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:30 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:30 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:30 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:30.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:30 smithi067 ceph-mon[35103]: pgmap v359: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-13T18:17:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:30 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:30 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:30 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:30 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:30 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:30 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:30 smithi007 ceph-mon[30588]: pgmap v359: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-13T18:17:31.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:17:31.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:17:31.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:17:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:17:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:32.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:17:32.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:17:32.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:17:32.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:32 smithi116 ceph-mon[35109]: pgmap v360: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:17:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:32 smithi067 ceph-mon[35103]: pgmap v360: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:17:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:32 smithi007 ceph-mon[30588]: pgmap v360: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:17:34.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:34 smithi116 ceph-mon[35109]: pgmap v361: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:17:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:34 smithi067 ceph-mon[35103]: pgmap v361: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:17:35.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:34 smithi007 ceph-mon[30588]: pgmap v361: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:17:36.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:36 smithi116 ceph-mon[35109]: pgmap v362: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T18:17:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:36 smithi067 ceph-mon[35103]: pgmap v362: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T18:17:37.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:36 smithi007 ceph-mon[30588]: pgmap v362: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T18:17:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:38 smithi116 ceph-mon[35109]: pgmap v363: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:17:38.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:38 smithi067 ceph-mon[35103]: pgmap v363: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:17:39.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:38 smithi007 ceph-mon[30588]: pgmap v363: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:17:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:40 smithi116 ceph-mon[35109]: pgmap v364: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:40 smithi067 ceph-mon[35103]: pgmap v364: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:41.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:40 smithi007 ceph-mon[30588]: pgmap v364: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:42 smithi116 ceph-mon[35109]: pgmap v365: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:42 smithi067 ceph-mon[35103]: pgmap v365: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:42 smithi007 ceph-mon[30588]: pgmap v365: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:17:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:44 smithi116 ceph-mon[35109]: pgmap v366: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:44 smithi067 ceph-mon[35103]: pgmap v366: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:45.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:44 smithi007 ceph-mon[30588]: pgmap v366: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:46 smithi116 ceph-mon[35109]: pgmap v367: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:46 smithi067 ceph-mon[35103]: pgmap v367: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:47.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:46 smithi007 ceph-mon[30588]: pgmap v367: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:17:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:48 smithi116 ceph-mon[35109]: pgmap v368: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:17:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:48 smithi067 ceph-mon[35103]: pgmap v368: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:17:49.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:48 smithi007 ceph-mon[30588]: pgmap v368: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:17:50.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:50 smithi116 ceph-mon[35109]: pgmap v369: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:50 smithi067 ceph-mon[35103]: pgmap v369: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:51.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:50 smithi007 ceph-mon[30588]: pgmap v369: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:17:52.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:52 smithi116 ceph-mon[35109]: pgmap v370: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:17:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:52 smithi067 ceph-mon[35103]: pgmap v370: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:17:53.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:52 smithi007 ceph-mon[30588]: pgmap v370: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-13T18:17:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:54 smithi116 ceph-mon[35109]: pgmap v371: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:17:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:54 smithi067 ceph-mon[35103]: pgmap v371: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:17:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:54 smithi007 ceph-mon[30588]: pgmap v371: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:17:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:56 smithi116 ceph-mon[35109]: pgmap v372: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:17:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:56 smithi067 ceph-mon[35103]: pgmap v372: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:17:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:56 smithi007 ceph-mon[30588]: pgmap v372: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:17:58.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:17:58 smithi007 ceph-mon[30588]: pgmap v373: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-13T18:17:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:17:58 smithi116 ceph-mon[35109]: pgmap v373: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-13T18:17:58.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:17:58 smithi067 ceph-mon[35103]: pgmap v373: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-13T18:18:00.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:00 smithi116 ceph-mon[35109]: pgmap v374: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:18:00.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:00 smithi067 ceph-mon[35103]: pgmap v374: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:18:01.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:00 smithi007 ceph-mon[30588]: pgmap v374: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:18:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:02 smithi116 ceph-mon[35109]: pgmap v375: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-13T18:18:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:02 smithi067 ceph-mon[35103]: pgmap v375: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-13T18:18:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:02 smithi007 ceph-mon[30588]: pgmap v375: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-13T18:18:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:04 smithi116 ceph-mon[35109]: pgmap v376: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:18:04.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:04 smithi067 ceph-mon[35103]: pgmap v376: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:18:05.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:04 smithi007 ceph-mon[30588]: pgmap v376: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:18:06.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:06 smithi116 ceph-mon[35109]: pgmap v377: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:18:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:06 smithi067 ceph-mon[35103]: pgmap v377: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:18:07.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:06 smithi007 ceph-mon[30588]: pgmap v377: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:18:08.903 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:08 smithi007 ceph-mon[30588]: pgmap v378: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:18:08.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:08 smithi116 ceph-mon[35109]: pgmap v378: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:18:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:08 smithi067 ceph-mon[35103]: pgmap v378: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:18:10.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:10 smithi116 ceph-mon[35109]: pgmap v379: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:18:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:10 smithi067 ceph-mon[35103]: pgmap v379: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:18:11.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:10 smithi007 ceph-mon[30588]: pgmap v379: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:18:12.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:12 smithi116 ceph-mon[35109]: pgmap v380: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:18:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:12 smithi067 ceph-mon[35103]: pgmap v380: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:18:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:12 smithi007 ceph-mon[30588]: pgmap v380: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:18:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:14 smithi116 ceph-mon[35109]: pgmap v381: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:14 smithi067 ceph-mon[35103]: pgmap v381: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:15.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:14 smithi007 ceph-mon[30588]: pgmap v381: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:16 smithi116 ceph-mon[35109]: pgmap v382: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:16 smithi067 ceph-mon[35103]: pgmap v382: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:17.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:16 smithi007 ceph-mon[30588]: pgmap v382: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:18 smithi116 ceph-mon[35109]: pgmap v383: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-13T18:18:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:18 smithi067 ceph-mon[35103]: pgmap v383: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-13T18:18:19.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:18 smithi007 ceph-mon[30588]: pgmap v383: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-13T18:18:20.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:20 smithi116 ceph-mon[35109]: pgmap v384: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-13T18:18:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:20 smithi067 ceph-mon[35103]: pgmap v384: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-13T18:18:21.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:20 smithi007 ceph-mon[30588]: pgmap v384: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-13T18:18:22.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:22 smithi116 ceph-mon[35109]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:18:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:22 smithi067 ceph-mon[35103]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:18:23.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:22 smithi007 ceph-mon[30588]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:18:24.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:24 smithi116 ceph-mon[35109]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:24 smithi067 ceph-mon[35103]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:24 smithi007 ceph-mon[30588]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-13T18:18:26.348 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 59% (7507/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 96% (12284/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:18:26.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:26 smithi116 ceph-mon[35109]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:18:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:26 smithi067 ceph-mon[35103]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:18:27.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:26 smithi007 ceph-mon[30588]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:18:27.386 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:18:27.386 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T18:18:27.386 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:18:27.386 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:18:27.386 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T18:18:27.387 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:18:27.404 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:18:27.485 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:18:27.490 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:18:27.490 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:18:28.267 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:18:28.381 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:18:28.448 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:18:28.451 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:18:28.452 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:18:28.517 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:18:28.524 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:18:28.524 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:18:28.601 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-13T18:18:28.603 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-13T18:18:28.603 DEBUG:teuthology.orchestra.run.smithi007:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-13T18:18:28.690 INFO:tasks.workunit.client.0.smithi007.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-13T18:18:28.691 INFO:tasks.workunit.client.0.smithi007.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-13T18:18:28.692 INFO:tasks.workunit.client.0.smithi007.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-13T18:18:28.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:28 smithi116 ceph-mon[35109]: pgmap v388: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:18:28.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:28 smithi067 ceph-mon[35103]: pgmap v388: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:18:29.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:28 smithi007 ceph-mon[30588]: pgmap v388: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-13T18:18:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:30 smithi116 ceph-mon[35109]: pgmap v389: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:18:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:30 smithi067 ceph-mon[35103]: pgmap v389: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:18:31.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:30 smithi007 ceph-mon[30588]: pgmap v389: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-13T18:18:31.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:18:31.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:31.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:31 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:31.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:18:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:31 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:32.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:18:32.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:32.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:31 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:32.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:18:32.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:18:32.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:32.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:32 smithi116 ceph-mon[35109]: pgmap v390: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-13T18:18:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:18:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:18:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:32 smithi067 ceph-mon[35103]: pgmap v390: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-13T18:18:33.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:18:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:18:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:18:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:32 smithi007 ceph-mon[30588]: pgmap v390: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-13T18:18:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:34 smithi116 ceph-mon[35109]: pgmap v391: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-13T18:18:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:34 smithi067 ceph-mon[35103]: pgmap v391: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-13T18:18:35.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:34 smithi007 ceph-mon[30588]: pgmap v391: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-13T18:18:36.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:36 smithi116 ceph-mon[35109]: pgmap v392: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-13T18:18:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:36 smithi067 ceph-mon[35103]: pgmap v392: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-13T18:18:37.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:36 smithi007 ceph-mon[30588]: pgmap v392: 97 pgs: 97 active+clean; 706 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-13T18:18:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:38 smithi116 ceph-mon[35109]: pgmap v393: 97 pgs: 97 active+clean; 761 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-09-13T18:18:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:38 smithi067 ceph-mon[35103]: pgmap v393: 97 pgs: 97 active+clean; 761 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-09-13T18:18:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:38 smithi007 ceph-mon[30588]: pgmap v393: 97 pgs: 97 active+clean; 761 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2024-09-13T18:18:40.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:40 smithi116 ceph-mon[35109]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-13T18:18:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:40 smithi116 ceph-mon[35109]: pgmap v394: 97 pgs: 97 active+clean; 762 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 KiB/s wr, 13 op/s 2024-09-13T18:18:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:40 smithi067 ceph-mon[35103]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-13T18:18:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:40 smithi067 ceph-mon[35103]: pgmap v394: 97 pgs: 97 active+clean; 762 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 KiB/s wr, 13 op/s 2024-09-13T18:18:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:40 smithi007 ceph-mon[30588]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-13T18:18:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:40 smithi007 ceph-mon[30588]: pgmap v394: 97 pgs: 97 active+clean; 762 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 KiB/s wr, 13 op/s 2024-09-13T18:18:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:42 smithi116 ceph-mon[35109]: pgmap v395: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-13T18:18:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:42 smithi067 ceph-mon[35103]: pgmap v395: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-13T18:18:43.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:42 smithi007 ceph-mon[30588]: pgmap v395: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-13T18:18:44.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:44 smithi116 ceph-mon[35109]: pgmap v396: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:44 smithi067 ceph-mon[35103]: pgmap v396: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:45.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:44 smithi007 ceph-mon[30588]: pgmap v396: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:46 smithi116 ceph-mon[35109]: pgmap v397: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:46 smithi067 ceph-mon[35103]: pgmap v397: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:47.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:46 smithi007 ceph-mon[30588]: pgmap v397: 97 pgs: 97 active+clean; 819 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:48 smithi116 ceph-mon[35109]: pgmap v398: 97 pgs: 97 active+clean; 884 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:18:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:48 smithi067 ceph-mon[35103]: pgmap v398: 97 pgs: 97 active+clean; 884 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:18:49.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:48 smithi007 ceph-mon[30588]: pgmap v398: 97 pgs: 97 active+clean; 884 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:18:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:50 smithi116 ceph-mon[35109]: pgmap v399: 97 pgs: 97 active+clean; 884 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:18:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:50 smithi067 ceph-mon[35103]: pgmap v399: 97 pgs: 97 active+clean; 884 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:18:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:50 smithi007 ceph-mon[30588]: pgmap v399: 97 pgs: 97 active+clean; 884 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:18:52.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:52 smithi116 ceph-mon[35109]: pgmap v400: 97 pgs: 97 active+clean; 939 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:18:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:52 smithi067 ceph-mon[35103]: pgmap v400: 97 pgs: 97 active+clean; 939 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:18:53.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:52 smithi007 ceph-mon[30588]: pgmap v400: 97 pgs: 97 active+clean; 939 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:18:54.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:54 smithi116 ceph-mon[35109]: pgmap v401: 97 pgs: 97 active+clean; 939 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:54 smithi067 ceph-mon[35103]: pgmap v401: 97 pgs: 97 active+clean; 939 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:54 smithi007 ceph-mon[30588]: pgmap v401: 97 pgs: 97 active+clean; 939 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:18:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:56 smithi116 ceph-mon[35109]: pgmap v402: 97 pgs: 97 active+clean; 939 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:18:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:56 smithi067 ceph-mon[35103]: pgmap v402: 97 pgs: 97 active+clean; 939 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:18:57.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:56 smithi007 ceph-mon[30588]: pgmap v402: 97 pgs: 97 active+clean; 939 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:18:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:18:58 smithi116 ceph-mon[35109]: pgmap v403: 97 pgs: 97 active+clean; 1003 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:18:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:18:58 smithi067 ceph-mon[35103]: pgmap v403: 97 pgs: 97 active+clean; 1003 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:18:59.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:18:58 smithi007 ceph-mon[30588]: pgmap v403: 97 pgs: 97 active+clean; 1003 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:00.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:00 smithi116 ceph-mon[35109]: pgmap v404: 97 pgs: 97 active+clean; 1003 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:00.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:00 smithi067 ceph-mon[35103]: pgmap v404: 97 pgs: 97 active+clean; 1003 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:01.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:00 smithi007 ceph-mon[30588]: pgmap v404: 97 pgs: 97 active+clean; 1003 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:02 smithi116 ceph-mon[35109]: pgmap v405: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:02 smithi067 ceph-mon[35103]: pgmap v405: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:02 smithi007 ceph-mon[30588]: pgmap v405: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:04 smithi116 ceph-mon[35109]: pgmap v406: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:19:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:04 smithi067 ceph-mon[35103]: pgmap v406: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:19:05.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:04 smithi007 ceph-mon[30588]: pgmap v406: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:19:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:06 smithi116 ceph-mon[35109]: pgmap v407: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:06 smithi067 ceph-mon[35103]: pgmap v407: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:07.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:06 smithi007 ceph-mon[30588]: pgmap v407: 97 pgs: 97 active+clean; 1.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:08 smithi007 ceph-mon[30588]: pgmap v408: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:09.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:08 smithi116 ceph-mon[35109]: pgmap v408: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:09.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:08 smithi067 ceph-mon[35103]: pgmap v408: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:10.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:10 smithi116 ceph-mon[35109]: pgmap v409: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:10 smithi067 ceph-mon[35103]: pgmap v409: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:10 smithi007 ceph-mon[30588]: pgmap v409: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:12 smithi116 ceph-mon[35109]: pgmap v410: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:12 smithi067 ceph-mon[35103]: pgmap v410: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:13.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:12 smithi007 ceph-mon[30588]: pgmap v410: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:14 smithi116 ceph-mon[35109]: pgmap v411: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:14 smithi067 ceph-mon[35103]: pgmap v411: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:14 smithi007 ceph-mon[30588]: pgmap v411: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:16 smithi116 ceph-mon[35109]: pgmap v412: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:16 smithi067 ceph-mon[35103]: pgmap v412: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:17.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:16 smithi007 ceph-mon[30588]: pgmap v412: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:18 smithi116 ceph-mon[35109]: pgmap v413: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:18 smithi067 ceph-mon[35103]: pgmap v413: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:19.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:18 smithi007 ceph-mon[30588]: pgmap v413: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:20.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:20 smithi116 ceph-mon[35109]: pgmap v414: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:20 smithi067 ceph-mon[35103]: pgmap v414: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:21.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:20 smithi007 ceph-mon[30588]: pgmap v414: 97 pgs: 97 active+clean; 1.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:22.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:22 smithi116 ceph-mon[35109]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:22 smithi067 ceph-mon[35103]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:23.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:22 smithi007 ceph-mon[30588]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:24.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:24 smithi116 ceph-mon[35109]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:24 smithi067 ceph-mon[35103]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:24 smithi007 ceph-mon[30588]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:26.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:26 smithi116 ceph-mon[35109]: pgmap v417: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:26 smithi067 ceph-mon[35103]: pgmap v417: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:27.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:26 smithi007 ceph-mon[30588]: pgmap v417: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:28.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:28 smithi116 ceph-mon[35109]: pgmap v418: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:28.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:28 smithi067 ceph-mon[35103]: pgmap v418: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:29.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:28 smithi007 ceph-mon[30588]: pgmap v418: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:30 smithi116 ceph-mon[35109]: pgmap v419: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:30 smithi067 ceph-mon[35103]: pgmap v419: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:30 smithi007 ceph-mon[30588]: pgmap v419: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:32.157 INFO:tasks.workunit.client.0.smithi007.stdout:1/600: open fd = 3 2024-09-13T18:19:32.157 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.157 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:2/600: open fd = 3 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:3/600: open fd = 3 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:4/600: open fd = 3 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.158 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:5/600: open fd = 3 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:6/600: open fd = 3 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:7/600: open fd = 3 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.159 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:8/600: open fd = 3 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:9/600: open fd = 3 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:10/600: open fd = 3 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.160 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:11/600: open fd = 3 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:12/600: open fd = 3 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:13/600: open fd = 3 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.161 INFO:tasks.workunit.client.0.smithi007.stdout:14/600: open fd = 3 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:15/600: open fd = 3 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:16/600: open fd = 3 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:17/600: open fd = 3 2024-09-13T18:19:32.162 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:18/600: open fd = 3 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:19/600: open fd = 3 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:20/600: open fd = 3 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.163 INFO:tasks.workunit.client.0.smithi007.stdout:21/600: open fd = 3 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:22/600: open fd = 3 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:23/600: open fd = 3 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:24/600: open fd = 3 2024-09-13T18:19:32.164 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:25/600: open fd = 3 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:26/600: open fd = 3 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:27/600: open fd = 3 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.165 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:28/600: open fd = 3 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:29/600: open fd = 3 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.166 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:30/600: open fd = 3 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:31/600: open fd = 3 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:32/600: open fd = 3 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:33/600: open fd = 3 2024-09-13T18:19:32.167 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:34/600: open fd = 3 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:35/600: open fd = 3 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:36/600: open fd = 3 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.168 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:37/600: open fd = 3 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:38/600: open fd = 3 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:39/600: open fd = 3 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:40/600: open fd = 3 2024-09-13T18:19:32.169 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:41/600: open fd = 3 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:42/600: open fd = 3 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:43/600: open fd = 3 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.170 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:44/600: open fd = 3 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:45/600: open fd = 3 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:46/600: open fd = 3 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.171 INFO:tasks.workunit.client.0.smithi007.stdout:47/600: open fd = 3 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:48/600: open fd = 3 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:49/600: open fd = 3 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:50/600: open fd = 3 2024-09-13T18:19:32.172 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:51/600: open fd = 3 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:52/600: open fd = 3 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:53/600: open fd = 3 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.173 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:54/600: open fd = 3 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:55/600: open fd = 3 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:56/600: open fd = 3 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:57/600: open fd = 3 2024-09-13T18:19:32.174 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:58/600: open fd = 3 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:59/600: open fd = 3 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:60/600: open fd = 3 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.175 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:61/600: open fd = 3 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:62/600: open fd = 3 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:63/600: open fd = 3 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:19:32.176 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:19:32.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:32 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:19:32.746 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:32 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:19:32.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:32 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: pgmap v420: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: pgmap v420: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:33.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:19:33.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:19:33.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: pgmap v420: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:19:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:19:33.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:19:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:34 smithi116 ceph-mon[35109]: pgmap v421: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:19:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:34 smithi067 ceph-mon[35103]: pgmap v421: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:19:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:34 smithi007 ceph-mon[30588]: pgmap v421: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:19:36.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:36 smithi116 ceph-mon[35109]: pgmap v422: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:36 smithi067 ceph-mon[35103]: pgmap v422: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:37.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:36 smithi007 ceph-mon[30588]: pgmap v422: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:38 smithi116 ceph-mon[35109]: pgmap v423: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:38 smithi067 ceph-mon[35103]: pgmap v423: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:38 smithi007 ceph-mon[30588]: pgmap v423: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:19:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:40 smithi116 ceph-mon[35109]: pgmap v424: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:40 smithi067 ceph-mon[35103]: pgmap v424: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:40 smithi007 ceph-mon[30588]: pgmap v424: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:42 smithi116 ceph-mon[35109]: pgmap v425: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-13T18:19:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:42 smithi067 ceph-mon[35103]: pgmap v425: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-13T18:19:43.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:42 smithi007 ceph-mon[30588]: pgmap v425: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-13T18:19:44.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:44 smithi116 ceph-mon[35109]: pgmap v426: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 14 op/s 2024-09-13T18:19:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:44 smithi067 ceph-mon[35103]: pgmap v426: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 14 op/s 2024-09-13T18:19:45.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:44 smithi007 ceph-mon[30588]: pgmap v426: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 14 op/s 2024-09-13T18:19:46.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:46 smithi116 ceph-mon[35109]: pgmap v427: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-09-13T18:19:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:46 smithi067 ceph-mon[35103]: pgmap v427: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-09-13T18:19:47.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:46 smithi007 ceph-mon[30588]: pgmap v427: 97 pgs: 97 active+clean; 1.5 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-09-13T18:19:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:48 smithi116 ceph-mon[35109]: pgmap v428: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:19:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:48 smithi067 ceph-mon[35103]: pgmap v428: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:19:49.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:48 smithi007 ceph-mon[30588]: pgmap v428: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:19:50.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:50 smithi116 ceph-mon[35109]: pgmap v429: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:50 smithi067 ceph-mon[35103]: pgmap v429: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:51.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:50 smithi007 ceph-mon[30588]: pgmap v429: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:52.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:52 smithi116 ceph-mon[35109]: pgmap v430: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:19:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:52 smithi067 ceph-mon[35103]: pgmap v430: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:19:53.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:52 smithi007 ceph-mon[30588]: pgmap v430: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:19:54.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:54 smithi116 ceph-mon[35109]: pgmap v431: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:54 smithi067 ceph-mon[35103]: pgmap v431: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:54 smithi007 ceph-mon[30588]: pgmap v431: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:56 smithi116 ceph-mon[35109]: pgmap v432: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:56 smithi067 ceph-mon[35103]: pgmap v432: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:56 smithi007 ceph-mon[30588]: pgmap v432: 97 pgs: 97 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:19:58.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:19:58 smithi116 ceph-mon[35109]: pgmap v433: 97 pgs: 97 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:19:58 smithi067 ceph-mon[35103]: pgmap v433: 97 pgs: 97 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:19:59.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:19:58 smithi007 ceph-mon[30588]: pgmap v433: 97 pgs: 97 active+clean; 1.7 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-13T18:20:00.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:00 smithi116 ceph-mon[35109]: overall HEALTH_OK 2024-09-13T18:20:00.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:00 smithi067 ceph-mon[35103]: overall HEALTH_OK 2024-09-13T18:20:00.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:00 smithi007 ceph-mon[30588]: overall HEALTH_OK 2024-09-13T18:20:01.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:01 smithi116 ceph-mon[35109]: pgmap v434: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:01.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:01 smithi067 ceph-mon[35103]: pgmap v434: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:01 smithi007 ceph-mon[30588]: pgmap v434: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:02 smithi116 ceph-mon[35109]: pgmap v435: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:20:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:02 smithi067 ceph-mon[35103]: pgmap v435: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:20:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:02 smithi007 ceph-mon[30588]: pgmap v435: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:20:04.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:04 smithi116 ceph-mon[35109]: pgmap v436: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:04 smithi067 ceph-mon[35103]: pgmap v436: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:05.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:04 smithi007 ceph-mon[30588]: pgmap v436: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:06 smithi116 ceph-mon[35109]: pgmap v437: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:06 smithi067 ceph-mon[35103]: pgmap v437: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:07.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:06 smithi007 ceph-mon[30588]: pgmap v437: 97 pgs: 97 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:08 smithi116 ceph-mon[35109]: pgmap v438: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:08 smithi067 ceph-mon[35103]: pgmap v438: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:08 smithi007 ceph-mon[30588]: pgmap v438: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:10.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:10 smithi116 ceph-mon[35109]: pgmap v439: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:10 smithi067 ceph-mon[35103]: pgmap v439: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:10 smithi007 ceph-mon[30588]: pgmap v439: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:12.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:12 smithi116 ceph-mon[35109]: pgmap v440: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:20:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:12 smithi067 ceph-mon[35103]: pgmap v440: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:20:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:12 smithi007 ceph-mon[30588]: pgmap v440: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:20:14.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:14 smithi116 ceph-mon[35109]: pgmap v441: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:14 smithi067 ceph-mon[35103]: pgmap v441: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:14 smithi007 ceph-mon[30588]: pgmap v441: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:16 smithi116 ceph-mon[35109]: pgmap v442: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:16 smithi067 ceph-mon[35103]: pgmap v442: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:17.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:16 smithi007 ceph-mon[30588]: pgmap v442: 97 pgs: 97 active+clean; 1.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:18 smithi116 ceph-mon[35109]: pgmap v443: 97 pgs: 97 active+clean; 1.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:18 smithi067 ceph-mon[35103]: pgmap v443: 97 pgs: 97 active+clean; 1.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:19.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:18 smithi007 ceph-mon[30588]: pgmap v443: 97 pgs: 97 active+clean; 1.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:20.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:20 smithi116 ceph-mon[35109]: pgmap v444: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:20 smithi067 ceph-mon[35103]: pgmap v444: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:21.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:20 smithi007 ceph-mon[30588]: pgmap v444: 97 pgs: 97 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:22.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:22 smithi116 ceph-mon[35109]: pgmap v445: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:22 smithi067 ceph-mon[35103]: pgmap v445: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:23.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:22 smithi007 ceph-mon[30588]: pgmap v445: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:24.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:24 smithi116 ceph-mon[35109]: pgmap v446: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:20:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:24 smithi067 ceph-mon[35103]: pgmap v446: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:20:25.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:24 smithi007 ceph-mon[30588]: pgmap v446: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:20:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:26 smithi116 ceph-mon[35109]: pgmap v447: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:20:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:26 smithi067 ceph-mon[35103]: pgmap v447: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:20:27.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:26 smithi007 ceph-mon[30588]: pgmap v447: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:20:28.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:28 smithi116 ceph-mon[35109]: pgmap v448: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:28.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:28 smithi067 ceph-mon[35103]: pgmap v448: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:29.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:28 smithi007 ceph-mon[30588]: pgmap v448: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:30 smithi116 ceph-mon[35109]: pgmap v449: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:30 smithi067 ceph-mon[35103]: pgmap v449: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:30 smithi007 ceph-mon[30588]: pgmap v449: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:32.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:32 smithi116 ceph-mon[35109]: pgmap v450: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:32 smithi067 ceph-mon[35103]: pgmap v450: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:32 smithi007 ceph-mon[30588]: pgmap v450: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:33.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:33 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:20:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:33 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:20:34.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:33 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:20:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:20:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:20:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:20:34.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:34 smithi116 ceph-mon[35109]: pgmap v451: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:34.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:20:34.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:20:34.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:20:34.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:34 smithi067 ceph-mon[35103]: pgmap v451: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:20:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:20:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:20:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:34 smithi007 ceph-mon[30588]: pgmap v451: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:35.617 INFO:tasks.workunit.client.0.smithi007.stdout:64/600: open fd = 3 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:65/600: open fd = 3 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:66/600: open fd = 3 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:67/600: open fd = 3 2024-09-13T18:20:35.618 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:68/600: open fd = 3 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:69/600: open fd = 3 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:70/600: open fd = 3 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.619 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:71/600: open fd = 3 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:72/600: open fd = 3 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:73/600: open fd = 3 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.620 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:74/600: open fd = 3 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:75/600: open fd = 3 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:76/600: open fd = 3 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.621 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:77/600: open fd = 3 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:78/600: open fd = 3 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:79/600: open fd = 3 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.622 INFO:tasks.workunit.client.0.smithi007.stdout:80/600: open fd = 3 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:81/600: open fd = 3 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:82/600: open fd = 3 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:83/600: open fd = 3 2024-09-13T18:20:35.623 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:84/600: open fd = 3 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:85/600: open fd = 3 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:86/600: open fd = 3 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.624 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:87/600: open fd = 3 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:88/600: open fd = 3 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:89/600: open fd = 3 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.625 INFO:tasks.workunit.client.0.smithi007.stdout:90/600: open fd = 3 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:91/600: open fd = 3 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:92/600: open fd = 3 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:93/600: open fd = 3 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.626 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:94/600: open fd = 3 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:95/600: open fd = 3 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:96/600: open fd = 3 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.627 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:97/600: open fd = 3 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:98/600: open fd = 3 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:99/600: open fd = 3 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:100/600: open fd = 3 2024-09-13T18:20:35.628 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:101/600: open fd = 3 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:102/600: open fd = 3 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:103/600: open fd = 3 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.629 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:104/600: open fd = 3 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:105/600: open fd = 3 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:106/600: open fd = 3 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:107/600: open fd = 3 2024-09-13T18:20:35.630 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:108/600: open fd = 3 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:109/600: open fd = 3 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:110/600: open fd = 3 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.631 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:111/600: open fd = 3 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:112/600: open fd = 3 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:113/600: open fd = 3 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.632 INFO:tasks.workunit.client.0.smithi007.stdout:114/600: open fd = 3 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:115/600: open fd = 3 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:116/600: open fd = 3 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:117/600: open fd = 3 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.633 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:118/600: open fd = 3 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:119/600: open fd = 3 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:120/600: open fd = 3 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.634 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:121/600: open fd = 3 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:122/600: open fd = 3 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:123/600: open fd = 3 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:124/600: open fd = 3 2024-09-13T18:20:35.635 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:125/600: open fd = 3 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:126/600: open fd = 3 2024-09-13T18:20:35.636 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:20:36.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:36 smithi116 ceph-mon[35109]: pgmap v452: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:36 smithi067 ceph-mon[35103]: pgmap v452: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:37.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:36 smithi007 ceph-mon[30588]: pgmap v452: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:38.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:38 smithi116 ceph-mon[35109]: pgmap v453: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:38 smithi067 ceph-mon[35103]: pgmap v453: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:38 smithi007 ceph-mon[30588]: pgmap v453: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:40.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:40 smithi116 ceph-mon[35109]: pgmap v454: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:20:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:40 smithi067 ceph-mon[35103]: pgmap v454: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:20:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:40 smithi007 ceph-mon[30588]: pgmap v454: 97 pgs: 97 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:20:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:42 smithi116 ceph-mon[35109]: pgmap v455: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:42 smithi067 ceph-mon[35103]: pgmap v455: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:42 smithi007 ceph-mon[30588]: pgmap v455: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:44 smithi116 ceph-mon[35109]: pgmap v456: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:44 smithi067 ceph-mon[35103]: pgmap v456: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:45.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:44 smithi007 ceph-mon[30588]: pgmap v456: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:46 smithi116 ceph-mon[35109]: pgmap v457: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:46 smithi067 ceph-mon[35103]: pgmap v457: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:47.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:46 smithi007 ceph-mon[30588]: pgmap v457: 97 pgs: 97 active+clean; 2.2 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:48 smithi116 ceph-mon[35109]: pgmap v458: 97 pgs: 97 active+clean; 2.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:48 smithi067 ceph-mon[35103]: pgmap v458: 97 pgs: 97 active+clean; 2.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:49.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:48 smithi007 ceph-mon[30588]: pgmap v458: 97 pgs: 97 active+clean; 2.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:50 smithi116 ceph-mon[35109]: pgmap v459: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:50 smithi067 ceph-mon[35103]: pgmap v459: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:51.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:50 smithi007 ceph-mon[30588]: pgmap v459: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:52.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:52 smithi116 ceph-mon[35109]: pgmap v460: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:52 smithi067 ceph-mon[35103]: pgmap v460: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:53.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:52 smithi007 ceph-mon[30588]: pgmap v460: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:20:54.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:54 smithi116 ceph-mon[35109]: pgmap v461: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:54 smithi067 ceph-mon[35103]: pgmap v461: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:55.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:54 smithi007 ceph-mon[30588]: pgmap v461: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:56 smithi116 ceph-mon[35109]: pgmap v462: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:56 smithi067 ceph-mon[35103]: pgmap v462: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:57.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:56 smithi007 ceph-mon[30588]: pgmap v462: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:20:58.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:20:58 smithi116 ceph-mon[35109]: pgmap v463: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:20:58 smithi067 ceph-mon[35103]: pgmap v463: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:20:59.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:20:58 smithi007 ceph-mon[30588]: pgmap v463: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:00.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:00 smithi116 ceph-mon[35109]: pgmap v464: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:00.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:00 smithi067 ceph-mon[35103]: pgmap v464: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:01.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:00 smithi007 ceph-mon[30588]: pgmap v464: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:02 smithi116 ceph-mon[35109]: pgmap v465: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:02 smithi067 ceph-mon[35103]: pgmap v465: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:02 smithi007 ceph-mon[30588]: pgmap v465: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:04 smithi116 ceph-mon[35109]: pgmap v466: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:04 smithi067 ceph-mon[35103]: pgmap v466: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:05.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:04 smithi007 ceph-mon[30588]: pgmap v466: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:06.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:06 smithi116 ceph-mon[35109]: pgmap v467: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:06 smithi067 ceph-mon[35103]: pgmap v467: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:07.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:06 smithi007 ceph-mon[30588]: pgmap v467: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:08.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:08 smithi116 ceph-mon[35109]: pgmap v468: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:08 smithi067 ceph-mon[35103]: pgmap v468: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:08 smithi007 ceph-mon[30588]: pgmap v468: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:10.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:10 smithi116 ceph-mon[35109]: pgmap v469: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:10 smithi067 ceph-mon[35103]: pgmap v469: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:10 smithi007 ceph-mon[30588]: pgmap v469: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:12.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:12 smithi116 ceph-mon[35109]: pgmap v470: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:21:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:12 smithi067 ceph-mon[35103]: pgmap v470: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:21:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:12 smithi007 ceph-mon[30588]: pgmap v470: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:21:14.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:14 smithi116 ceph-mon[35109]: pgmap v471: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:14.996 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:14 smithi067 ceph-mon[35103]: pgmap v471: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:14 smithi007 ceph-mon[30588]: pgmap v471: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:16 smithi116 ceph-mon[35109]: pgmap v472: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:16 smithi067 ceph-mon[35103]: pgmap v472: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:17.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:16 smithi007 ceph-mon[30588]: pgmap v472: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:18.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:18 smithi116 ceph-mon[35109]: pgmap v473: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:18 smithi067 ceph-mon[35103]: pgmap v473: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:19.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:18 smithi007 ceph-mon[30588]: pgmap v473: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:20.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:20 smithi116 ceph-mon[35109]: pgmap v474: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:20 smithi067 ceph-mon[35103]: pgmap v474: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:21.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:20 smithi007 ceph-mon[30588]: pgmap v474: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:22.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:22 smithi116 ceph-mon[35109]: pgmap v475: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:21:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:22 smithi067 ceph-mon[35103]: pgmap v475: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:21:23.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:22 smithi007 ceph-mon[30588]: pgmap v475: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:21:24.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:24 smithi116 ceph-mon[35109]: pgmap v476: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:24 smithi067 ceph-mon[35103]: pgmap v476: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:25.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:24 smithi007 ceph-mon[30588]: pgmap v476: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:26.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:26 smithi116 ceph-mon[35109]: pgmap v477: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:26 smithi067 ceph-mon[35103]: pgmap v477: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:27.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:26 smithi007 ceph-mon[30588]: pgmap v477: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:28.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:28 smithi116 ceph-mon[35109]: pgmap v478: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:28.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:28 smithi067 ceph-mon[35103]: pgmap v478: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:29.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:28 smithi007 ceph-mon[30588]: pgmap v478: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:30 smithi116 ceph-mon[35109]: pgmap v479: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:30 smithi067 ceph-mon[35103]: pgmap v479: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:30 smithi007 ceph-mon[30588]: pgmap v479: 97 pgs: 97 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:32.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:32 smithi116 ceph-mon[35109]: pgmap v480: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:32 smithi067 ceph-mon[35103]: pgmap v480: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:32 smithi007 ceph-mon[30588]: pgmap v480: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:34.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:34 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:34.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:34 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:34.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:34 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:35.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:35 smithi007 ceph-mon[30588]: pgmap v481: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:35.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:21:35.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:21:35.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:21:35.460 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:35 smithi116 ceph-mon[35109]: pgmap v481: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:35.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:21:35.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:21:35.461 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:21:35.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:35 smithi067 ceph-mon[35103]: pgmap v481: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:35.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:21:35.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:21:35.497 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:21:36.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:36 smithi116 ceph-mon[35109]: pgmap v482: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:36 smithi067 ceph-mon[35103]: pgmap v482: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:37.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:36 smithi007 ceph-mon[30588]: pgmap v482: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:38.088 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.088 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.088 INFO:tasks.workunit.client.0.smithi007.stdout:127/600: open fd = 3 2024-09-13T18:21:38.088 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.088 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.088 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.088 INFO:tasks.workunit.client.0.smithi007.stdout:128/600: open fd = 3 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:129/600: open fd = 3 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:130/600: open fd = 3 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.089 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:131/600: open fd = 3 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:132/600: open fd = 3 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.090 INFO:tasks.workunit.client.0.smithi007.stdout:133/600: open fd = 3 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:134/600: open fd = 3 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:135/600: open fd = 3 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.091 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:136/600: open fd = 3 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:137/600: open fd = 3 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.092 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:138/600: open fd = 3 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:139/600: open fd = 3 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.093 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:140/600: open fd = 3 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:141/600: open fd = 3 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:142/600: open fd = 3 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.094 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:143/600: open fd = 3 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:144/600: open fd = 3 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.095 INFO:tasks.workunit.client.0.smithi007.stdout:145/600: open fd = 3 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:146/600: open fd = 3 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:147/600: open fd = 3 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.096 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:148/600: open fd = 3 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:149/600: open fd = 3 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:150/600: open fd = 3 2024-09-13T18:21:38.097 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:151/600: open fd = 3 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:152/600: open fd = 3 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.098 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:153/600: open fd = 3 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:154/600: open fd = 3 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:155/600: open fd = 3 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.099 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:156/600: open fd = 3 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:157/600: open fd = 3 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:158/600: open fd = 3 2024-09-13T18:21:38.100 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:159/600: open fd = 3 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:160/600: open fd = 3 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.101 INFO:tasks.workunit.client.0.smithi007.stdout:161/600: open fd = 3 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:162/600: open fd = 3 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:163/600: open fd = 3 2024-09-13T18:21:38.102 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:164/600: open fd = 3 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:165/600: open fd = 3 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.103 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:166/600: open fd = 3 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:167/600: open fd = 3 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:168/600: open fd = 3 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.104 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:169/600: open fd = 3 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:170/600: open fd = 3 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:171/600: open fd = 3 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.105 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:172/600: open fd = 3 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:173/600: open fd = 3 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:174/600: open fd = 3 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.106 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:175/600: open fd = 3 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:176/600: open fd = 3 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:177/600: open fd = 3 2024-09-13T18:21:38.107 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:178/600: open fd = 3 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:179/600: open fd = 3 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.108 INFO:tasks.workunit.client.0.smithi007.stdout:180/600: open fd = 3 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:181/600: open fd = 3 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:182/600: open fd = 3 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.109 INFO:tasks.workunit.client.0.smithi007.stdout:183/600: open fd = 3 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:184/600: open fd = 3 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:185/600: open fd = 3 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.110 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:186/600: open fd = 3 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:187/600: open fd = 3 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:188/600: open fd = 3 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.111 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:21:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:38 smithi116 ceph-mon[35109]: pgmap v483: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:38 smithi067 ceph-mon[35103]: pgmap v483: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:38 smithi007 ceph-mon[30588]: pgmap v483: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:21:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:40 smithi116 ceph-mon[35109]: pgmap v484: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:40 smithi067 ceph-mon[35103]: pgmap v484: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:40 smithi007 ceph-mon[30588]: pgmap v484: 97 pgs: 97 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:42 smithi116 ceph-mon[35109]: pgmap v485: 97 pgs: 97 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:42 smithi067 ceph-mon[35103]: pgmap v485: 97 pgs: 97 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:42 smithi007 ceph-mon[30588]: pgmap v485: 97 pgs: 97 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:21:44.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:44 smithi116 ceph-mon[35109]: pgmap v486: 97 pgs: 97 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:45.001 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:44 smithi067 ceph-mon[35103]: pgmap v486: 97 pgs: 97 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:45.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:44 smithi007 ceph-mon[30588]: pgmap v486: 97 pgs: 97 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:46.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:46 smithi116 ceph-mon[35109]: pgmap v487: 97 pgs: 97 active+clean; 2.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:46 smithi067 ceph-mon[35103]: pgmap v487: 97 pgs: 97 active+clean; 2.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:47.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:46 smithi007 ceph-mon[30588]: pgmap v487: 97 pgs: 97 active+clean; 2.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:48.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:48 smithi116 ceph-mon[35109]: pgmap v488: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:48 smithi067 ceph-mon[35103]: pgmap v488: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:49.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:48 smithi007 ceph-mon[30588]: pgmap v488: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:50.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:50 smithi116 ceph-mon[35109]: pgmap v489: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:50.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:50 smithi067 ceph-mon[35103]: pgmap v489: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:51.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:50 smithi007 ceph-mon[30588]: pgmap v489: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:21:52.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:52 smithi116 ceph-mon[35109]: pgmap v490: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:21:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:52 smithi067 ceph-mon[35103]: pgmap v490: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:21:53.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:52 smithi007 ceph-mon[30588]: pgmap v490: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:21:54.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:54 smithi116 ceph-mon[35109]: pgmap v491: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:54 smithi067 ceph-mon[35103]: pgmap v491: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:54 smithi007 ceph-mon[30588]: pgmap v491: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:56 smithi116 ceph-mon[35109]: pgmap v492: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:56 smithi067 ceph-mon[35103]: pgmap v492: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:56 smithi007 ceph-mon[30588]: pgmap v492: 97 pgs: 97 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:21:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:21:58 smithi116 ceph-mon[35109]: pgmap v493: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:21:58 smithi067 ceph-mon[35103]: pgmap v493: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:21:59.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:21:58 smithi007 ceph-mon[30588]: pgmap v493: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:00.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:00 smithi116 ceph-mon[35109]: pgmap v494: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:22:00.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:00 smithi067 ceph-mon[35103]: pgmap v494: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:22:01.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:00 smithi007 ceph-mon[30588]: pgmap v494: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:22:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:02 smithi116 ceph-mon[35109]: pgmap v495: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:22:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:02 smithi067 ceph-mon[35103]: pgmap v495: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:22:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:02 smithi007 ceph-mon[30588]: pgmap v495: 97 pgs: 97 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:22:05.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:05 smithi116 ceph-mon[35109]: pgmap v496: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:22:05.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:05 smithi067 ceph-mon[35103]: pgmap v496: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:22:06.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:05 smithi007 ceph-mon[30588]: pgmap v496: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:22:07.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:07 smithi116 ceph-mon[35109]: pgmap v497: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:22:08.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:07 smithi007 ceph-mon[30588]: pgmap v497: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:22:08.856 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:07 smithi067 ceph-mon[35103]: pgmap v497: 97 pgs: 97 active+clean; 3.1 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:22:09.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:09 smithi116 ceph-mon[35109]: pgmap v498: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:09.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:09 smithi067 ceph-mon[35103]: pgmap v498: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:10.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:09 smithi007 ceph-mon[30588]: pgmap v498: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:11.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:11 smithi116 ceph-mon[35109]: pgmap v499: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:11.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:11 smithi067 ceph-mon[35103]: pgmap v499: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:12.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:11 smithi007 ceph-mon[30588]: pgmap v499: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:13.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:13 smithi116 ceph-mon[35109]: pgmap v500: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:22:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:13 smithi067 ceph-mon[35103]: pgmap v500: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:22:14.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:13 smithi007 ceph-mon[30588]: pgmap v500: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-13T18:22:15.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:15 smithi116 ceph-mon[35109]: pgmap v501: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:15.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:15 smithi067 ceph-mon[35103]: pgmap v501: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:16.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:15 smithi007 ceph-mon[30588]: pgmap v501: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:17 smithi116 ceph-mon[35109]: pgmap v502: 97 pgs: 97 active+clean; 3.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:17 smithi067 ceph-mon[35103]: pgmap v502: 97 pgs: 97 active+clean; 3.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:18.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:17 smithi007 ceph-mon[30588]: pgmap v502: 97 pgs: 97 active+clean; 3.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:19.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:19 smithi116 ceph-mon[35109]: pgmap v503: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:22:19.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:19 smithi067 ceph-mon[35103]: pgmap v503: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:22:20.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:19 smithi007 ceph-mon[30588]: pgmap v503: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:22:21.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:21 smithi067 ceph-mon[35103]: pgmap v504: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:22.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:21 smithi007 ceph-mon[30588]: pgmap v504: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:22.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:21 smithi116 ceph-mon[35109]: pgmap v504: 97 pgs: 97 active+clean; 3.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:23.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:23 smithi067 ceph-mon[35103]: pgmap v505: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:22:24.013 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:23 smithi116 ceph-mon[35109]: pgmap v505: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:22:24.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:23 smithi007 ceph-mon[30588]: pgmap v505: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:22:25.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:25 smithi067 ceph-mon[35103]: pgmap v506: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:26.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:25 smithi007 ceph-mon[30588]: pgmap v506: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:26.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:25 smithi116 ceph-mon[35109]: pgmap v506: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:27.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:27 smithi067 ceph-mon[35103]: pgmap v507: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:28.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:27 smithi007 ceph-mon[30588]: pgmap v507: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:28.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:27 smithi116 ceph-mon[35109]: pgmap v507: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:29.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:29 smithi067 ceph-mon[35103]: pgmap v508: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:22:30.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:29 smithi007 ceph-mon[30588]: pgmap v508: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:22:30.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:29 smithi116 ceph-mon[35109]: pgmap v508: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:22:31.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:31 smithi067 ceph-mon[35103]: pgmap v509: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:32.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:31 smithi007 ceph-mon[30588]: pgmap v509: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:32.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:31 smithi116 ceph-mon[35109]: pgmap v509: 97 pgs: 97 active+clean; 3.4 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:33.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:33 smithi067 ceph-mon[35103]: pgmap v510: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:22:34.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:33 smithi007 ceph-mon[30588]: pgmap v510: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:22:34.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:33 smithi116 ceph-mon[35109]: pgmap v510: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:22:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:35 smithi067 ceph-mon[35103]: pgmap v511: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:22:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:22:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:22:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:22:35.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:22:36.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:35 smithi007 ceph-mon[30588]: pgmap v511: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:22:36.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:22:36.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:22:36.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:22:36.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:22:36.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:35 smithi116 ceph-mon[35109]: pgmap v511: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:22:36.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:22:36.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:22:36.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:22:36.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:22:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:37 smithi067 ceph-mon[35103]: pgmap v512: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:38.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:37 smithi007 ceph-mon[30588]: pgmap v512: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:38.217 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:37 smithi116 ceph-mon[35109]: pgmap v512: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:39 smithi067 ceph-mon[35103]: pgmap v513: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:39 smithi007 ceph-mon[30588]: pgmap v513: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:40.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:39 smithi116 ceph-mon[35109]: pgmap v513: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:40.565 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:189/600: open fd = 3 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:190/600: open fd = 3 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:191/600: open fd = 3 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.566 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.567 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.567 INFO:tasks.workunit.client.0.smithi007.stdout:192/600: open fd = 3 2024-09-13T18:22:40.567 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.567 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.567 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:193/600: open fd = 3 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:194/600: open fd = 3 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:195/600: open fd = 3 2024-09-13T18:22:40.568 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.569 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.569 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.569 INFO:tasks.workunit.client.0.smithi007.stdout:196/600: open fd = 3 2024-09-13T18:22:40.572 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.572 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.572 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.572 INFO:tasks.workunit.client.0.smithi007.stdout:197/600: open fd = 3 2024-09-13T18:22:40.573 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.573 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.573 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.573 INFO:tasks.workunit.client.0.smithi007.stdout:198/600: open fd = 3 2024-09-13T18:22:40.574 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.574 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.574 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.574 INFO:tasks.workunit.client.0.smithi007.stdout:199/600: open fd = 3 2024-09-13T18:22:40.574 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.575 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.575 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.575 INFO:tasks.workunit.client.0.smithi007.stdout:200/600: open fd = 3 2024-09-13T18:22:40.576 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.576 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.576 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.576 INFO:tasks.workunit.client.0.smithi007.stdout:201/600: open fd = 3 2024-09-13T18:22:40.577 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.577 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.577 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.577 INFO:tasks.workunit.client.0.smithi007.stdout:202/600: open fd = 3 2024-09-13T18:22:40.578 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.578 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.578 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.578 INFO:tasks.workunit.client.0.smithi007.stdout:203/600: open fd = 3 2024-09-13T18:22:40.578 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.579 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.579 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.579 INFO:tasks.workunit.client.0.smithi007.stdout:204/600: open fd = 3 2024-09-13T18:22:40.579 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.579 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.580 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.580 INFO:tasks.workunit.client.0.smithi007.stdout:205/600: open fd = 3 2024-09-13T18:22:40.580 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.580 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.580 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.581 INFO:tasks.workunit.client.0.smithi007.stdout:206/600: open fd = 3 2024-09-13T18:22:40.581 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.581 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.581 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.581 INFO:tasks.workunit.client.0.smithi007.stdout:207/600: open fd = 3 2024-09-13T18:22:40.582 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.582 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.582 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.582 INFO:tasks.workunit.client.0.smithi007.stdout:208/600: open fd = 3 2024-09-13T18:22:40.582 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:209/600: open fd = 3 2024-09-13T18:22:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.583 INFO:tasks.workunit.client.0.smithi007.stdout:210/600: open fd = 3 2024-09-13T18:22:40.584 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.584 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.584 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.584 INFO:tasks.workunit.client.0.smithi007.stdout:211/600: open fd = 3 2024-09-13T18:22:40.584 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.585 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.585 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.585 INFO:tasks.workunit.client.0.smithi007.stdout:212/600: open fd = 3 2024-09-13T18:22:40.585 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.585 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.585 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.586 INFO:tasks.workunit.client.0.smithi007.stdout:213/600: open fd = 3 2024-09-13T18:22:40.586 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.586 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.586 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.586 INFO:tasks.workunit.client.0.smithi007.stdout:214/600: open fd = 3 2024-09-13T18:22:40.587 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.587 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.587 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.587 INFO:tasks.workunit.client.0.smithi007.stdout:215/600: open fd = 3 2024-09-13T18:22:40.587 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.587 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.588 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.588 INFO:tasks.workunit.client.0.smithi007.stdout:216/600: open fd = 3 2024-09-13T18:22:40.588 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.588 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.588 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.589 INFO:tasks.workunit.client.0.smithi007.stdout:217/600: open fd = 3 2024-09-13T18:22:40.589 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.589 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.589 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.589 INFO:tasks.workunit.client.0.smithi007.stdout:218/600: open fd = 3 2024-09-13T18:22:40.589 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:219/600: open fd = 3 2024-09-13T18:22:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.590 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.591 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.591 INFO:tasks.workunit.client.0.smithi007.stdout:220/600: open fd = 3 2024-09-13T18:22:40.591 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.591 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.591 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.591 INFO:tasks.workunit.client.0.smithi007.stdout:221/600: open fd = 3 2024-09-13T18:22:40.592 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.592 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.592 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.592 INFO:tasks.workunit.client.0.smithi007.stdout:222/600: open fd = 3 2024-09-13T18:22:40.592 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.592 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.593 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.593 INFO:tasks.workunit.client.0.smithi007.stdout:223/600: open fd = 3 2024-09-13T18:22:40.593 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.593 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.593 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.594 INFO:tasks.workunit.client.0.smithi007.stdout:224/600: open fd = 3 2024-09-13T18:22:40.594 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.594 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.594 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.594 INFO:tasks.workunit.client.0.smithi007.stdout:225/600: open fd = 3 2024-09-13T18:22:40.594 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.595 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.595 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.595 INFO:tasks.workunit.client.0.smithi007.stdout:226/600: open fd = 3 2024-09-13T18:22:40.595 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.595 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.595 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.596 INFO:tasks.workunit.client.0.smithi007.stdout:227/600: open fd = 3 2024-09-13T18:22:40.596 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.596 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.596 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.596 INFO:tasks.workunit.client.0.smithi007.stdout:228/600: open fd = 3 2024-09-13T18:22:40.596 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.597 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.597 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.597 INFO:tasks.workunit.client.0.smithi007.stdout:229/600: open fd = 3 2024-09-13T18:22:40.597 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.597 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.597 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.598 INFO:tasks.workunit.client.0.smithi007.stdout:230/600: open fd = 3 2024-09-13T18:22:40.598 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.598 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.598 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.598 INFO:tasks.workunit.client.0.smithi007.stdout:231/600: open fd = 3 2024-09-13T18:22:40.599 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.599 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.599 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.599 INFO:tasks.workunit.client.0.smithi007.stdout:232/600: open fd = 3 2024-09-13T18:22:40.599 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.599 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.600 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.600 INFO:tasks.workunit.client.0.smithi007.stdout:233/600: open fd = 3 2024-09-13T18:22:40.600 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.600 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.600 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.600 INFO:tasks.workunit.client.0.smithi007.stdout:234/600: open fd = 3 2024-09-13T18:22:40.601 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.601 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.601 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.601 INFO:tasks.workunit.client.0.smithi007.stdout:235/600: open fd = 3 2024-09-13T18:22:40.601 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.602 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.602 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.602 INFO:tasks.workunit.client.0.smithi007.stdout:236/600: open fd = 3 2024-09-13T18:22:40.602 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.602 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.602 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.603 INFO:tasks.workunit.client.0.smithi007.stdout:237/600: open fd = 3 2024-09-13T18:22:40.603 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.603 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.603 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.603 INFO:tasks.workunit.client.0.smithi007.stdout:238/600: open fd = 3 2024-09-13T18:22:40.603 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.604 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.604 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.604 INFO:tasks.workunit.client.0.smithi007.stdout:239/600: open fd = 3 2024-09-13T18:22:40.604 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.604 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.605 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.605 INFO:tasks.workunit.client.0.smithi007.stdout:240/600: open fd = 3 2024-09-13T18:22:40.605 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.605 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.605 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.606 INFO:tasks.workunit.client.0.smithi007.stdout:241/600: open fd = 3 2024-09-13T18:22:40.606 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.606 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.606 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.606 INFO:tasks.workunit.client.0.smithi007.stdout:242/600: open fd = 3 2024-09-13T18:22:40.606 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.607 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.607 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.607 INFO:tasks.workunit.client.0.smithi007.stdout:243/600: open fd = 3 2024-09-13T18:22:40.607 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.607 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.607 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.608 INFO:tasks.workunit.client.0.smithi007.stdout:244/600: open fd = 3 2024-09-13T18:22:40.608 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.608 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.608 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.608 INFO:tasks.workunit.client.0.smithi007.stdout:245/600: open fd = 3 2024-09-13T18:22:40.609 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.609 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.609 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.609 INFO:tasks.workunit.client.0.smithi007.stdout:246/600: open fd = 3 2024-09-13T18:22:40.609 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.609 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.610 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.610 INFO:tasks.workunit.client.0.smithi007.stdout:247/600: open fd = 3 2024-09-13T18:22:40.610 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.610 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.610 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.610 INFO:tasks.workunit.client.0.smithi007.stdout:248/600: open fd = 3 2024-09-13T18:22:40.611 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.611 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.611 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.611 INFO:tasks.workunit.client.0.smithi007.stdout:249/600: open fd = 3 2024-09-13T18:22:40.611 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.612 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.612 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:22:40.612 INFO:tasks.workunit.client.0.smithi007.stdout:250/600: open fd = 3 2024-09-13T18:22:40.612 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:40.612 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:22:42.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:41 smithi007 ceph-mon[30588]: pgmap v514: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:42.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:41 smithi116 ceph-mon[35109]: pgmap v514: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:42.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:41 smithi067 ceph-mon[35103]: pgmap v514: 97 pgs: 97 active+clean; 3.5 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:44.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:43 smithi007 ceph-mon[30588]: pgmap v515: 97 pgs: 97 active+clean; 3.6 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:22:44.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:43 smithi116 ceph-mon[35109]: pgmap v515: 97 pgs: 97 active+clean; 3.6 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:22:44.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:43 smithi067 ceph-mon[35103]: pgmap v515: 97 pgs: 97 active+clean; 3.6 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:22:46.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:45 smithi007 ceph-mon[30588]: pgmap v516: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:46.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:45 smithi116 ceph-mon[35109]: pgmap v516: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:46.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:45 smithi067 ceph-mon[35103]: pgmap v516: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:48.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:47 smithi007 ceph-mon[30588]: pgmap v517: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:48.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:47 smithi116 ceph-mon[35109]: pgmap v517: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:48.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:47 smithi067 ceph-mon[35103]: pgmap v517: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:50.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:49 smithi007 ceph-mon[30588]: pgmap v518: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:50.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:49 smithi116 ceph-mon[35109]: pgmap v518: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:50.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:49 smithi067 ceph-mon[35103]: pgmap v518: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:22:52.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:51 smithi007 ceph-mon[30588]: pgmap v519: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:52.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:51 smithi116 ceph-mon[35109]: pgmap v519: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:51 smithi067 ceph-mon[35103]: pgmap v519: 97 pgs: 97 active+clean; 3.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:22:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:53 smithi007 ceph-mon[30588]: pgmap v520: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:22:54.049 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:53 smithi067 ceph-mon[35103]: pgmap v520: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:22:54.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:53 smithi116 ceph-mon[35109]: pgmap v520: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:22:56.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:55 smithi007 ceph-mon[30588]: pgmap v521: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:56.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:55 smithi116 ceph-mon[35109]: pgmap v521: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:55 smithi067 ceph-mon[35103]: pgmap v521: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:58.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:57 smithi007 ceph-mon[30588]: pgmap v522: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:58.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:57 smithi116 ceph-mon[35109]: pgmap v522: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:22:58.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:57 smithi067 ceph-mon[35103]: pgmap v522: 97 pgs: 97 active+clean; 3.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:00.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:22:59 smithi007 ceph-mon[30588]: pgmap v523: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:00.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:22:59 smithi116 ceph-mon[35109]: pgmap v523: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:22:59 smithi067 ceph-mon[35103]: pgmap v523: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:02.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:01 smithi007 ceph-mon[30588]: pgmap v524: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:02.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:01 smithi116 ceph-mon[35109]: pgmap v524: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:02.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:01 smithi067 ceph-mon[35103]: pgmap v524: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:04.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:03 smithi007 ceph-mon[30588]: pgmap v525: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:04.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:03 smithi116 ceph-mon[35109]: pgmap v525: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:04.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:03 smithi067 ceph-mon[35103]: pgmap v525: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:06.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:05 smithi116 ceph-mon[35109]: pgmap v526: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:06.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:05 smithi067 ceph-mon[35103]: pgmap v526: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:06.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:05 smithi007 ceph-mon[30588]: pgmap v526: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:08.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:07 smithi116 ceph-mon[35109]: pgmap v527: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:08.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:07 smithi067 ceph-mon[35103]: pgmap v527: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:08.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:07 smithi007 ceph-mon[30588]: pgmap v527: 97 pgs: 97 active+clean; 3.8 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:10.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:09 smithi116 ceph-mon[35109]: pgmap v528: 97 pgs: 97 active+clean; 3.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:09 smithi067 ceph-mon[35103]: pgmap v528: 97 pgs: 97 active+clean; 3.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:10.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:09 smithi007 ceph-mon[30588]: pgmap v528: 97 pgs: 97 active+clean; 3.9 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:12.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:11 smithi116 ceph-mon[35109]: pgmap v529: 97 pgs: 97 active+clean; 3.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:11 smithi067 ceph-mon[35103]: pgmap v529: 97 pgs: 97 active+clean; 3.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:12.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:11 smithi007 ceph-mon[30588]: pgmap v529: 97 pgs: 97 active+clean; 3.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:14.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:13 smithi116 ceph-mon[35109]: pgmap v530: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:14.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:13 smithi067 ceph-mon[35103]: pgmap v530: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:13 smithi007 ceph-mon[30588]: pgmap v530: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:16.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:15 smithi116 ceph-mon[35109]: pgmap v531: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:16.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:15 smithi067 ceph-mon[35103]: pgmap v531: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:16.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:15 smithi007 ceph-mon[30588]: pgmap v531: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:18.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:17 smithi116 ceph-mon[35109]: pgmap v532: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:18.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:17 smithi067 ceph-mon[35103]: pgmap v532: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:18.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:17 smithi007 ceph-mon[30588]: pgmap v532: 97 pgs: 97 active+clean; 3.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:20.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:19 smithi116 ceph-mon[35109]: pgmap v533: 97 pgs: 97 active+clean; 4.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:20.249 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:19 smithi067 ceph-mon[35103]: pgmap v533: 97 pgs: 97 active+clean; 4.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:20.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:19 smithi007 ceph-mon[30588]: pgmap v533: 97 pgs: 97 active+clean; 4.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:22.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:21 smithi116 ceph-mon[35109]: pgmap v534: 97 pgs: 97 active+clean; 4.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:22.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:21 smithi067 ceph-mon[35103]: pgmap v534: 97 pgs: 97 active+clean; 4.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:22.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:21 smithi007 ceph-mon[30588]: pgmap v534: 97 pgs: 97 active+clean; 4.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:24.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:23 smithi116 ceph-mon[35109]: pgmap v535: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:23:24.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:23 smithi067 ceph-mon[35103]: pgmap v535: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:23:24.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:23 smithi007 ceph-mon[30588]: pgmap v535: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:23:26.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:25 smithi116 ceph-mon[35109]: pgmap v536: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:25 smithi067 ceph-mon[35103]: pgmap v536: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:25 smithi007 ceph-mon[30588]: pgmap v536: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:28.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:27 smithi116 ceph-mon[35109]: pgmap v537: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:27 smithi067 ceph-mon[35103]: pgmap v537: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:28.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:27 smithi007 ceph-mon[30588]: pgmap v537: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:30.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:29 smithi116 ceph-mon[35109]: pgmap v538: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:29 smithi067 ceph-mon[35103]: pgmap v538: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:30.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:29 smithi007 ceph-mon[30588]: pgmap v538: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:23:32.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:31 smithi116 ceph-mon[35109]: pgmap v539: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:31 smithi067 ceph-mon[35103]: pgmap v539: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:31 smithi007 ceph-mon[30588]: pgmap v539: 97 pgs: 97 active+clean; 4.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:34.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:33 smithi116 ceph-mon[35109]: pgmap v540: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:33 smithi067 ceph-mon[35103]: pgmap v540: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:33 smithi007 ceph-mon[30588]: pgmap v540: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:36.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:35 smithi116 ceph-mon[35109]: pgmap v541: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:23:36.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:35 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:23:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:35 smithi067 ceph-mon[35103]: pgmap v541: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:23:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:35 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:23:36.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:35 smithi007 ceph-mon[30588]: pgmap v541: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:23:36.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:35 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: Unable to set osd_memory_target on smithi007 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:23:37.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:36 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:23:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-09-13T18:23:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: Unable to set osd_memory_target on smithi007 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T18:23:37.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:37.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:23:37.248 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:36 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi007 to 177.5M 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: Unable to set osd_memory_target on smithi007 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:23:37.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:36 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:23:38.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:38 smithi116 ceph-mon[35109]: pgmap v542: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:38 smithi067 ceph-mon[35103]: pgmap v542: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:38 smithi007 ceph-mon[30588]: pgmap v542: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:40.714 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:40 smithi116 ceph-mon[35109]: pgmap v543: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:23:41.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:40 smithi007 ceph-mon[30588]: pgmap v543: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:23:41.206 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:40 smithi067 ceph-mon[35103]: pgmap v543: 97 pgs: 97 active+clean; 4.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:23:42.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:42 smithi116 ceph-mon[35109]: pgmap v544: 97 pgs: 97 active+clean; 4.2 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:42 smithi067 ceph-mon[35103]: pgmap v544: 97 pgs: 97 active+clean; 4.2 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:42.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:42 smithi007 ceph-mon[30588]: pgmap v544: 97 pgs: 97 active+clean; 4.2 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:23:43.051 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:251/600: open fd = 3 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:252/600: open fd = 3 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:253/600: open fd = 3 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.052 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:254/600: open fd = 3 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:255/600: open fd = 3 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:256/600: open fd = 3 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.053 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:257/600: open fd = 3 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:258/600: open fd = 3 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:259/600: open fd = 3 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.054 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:260/600: open fd = 3 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:261/600: open fd = 3 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:262/600: open fd = 3 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.055 INFO:tasks.workunit.client.0.smithi007.stdout:263/600: open fd = 3 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:264/600: open fd = 3 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:265/600: open fd = 3 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.056 INFO:tasks.workunit.client.0.smithi007.stdout:266/600: open fd = 3 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:267/600: open fd = 3 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:268/600: open fd = 3 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:269/600: open fd = 3 2024-09-13T18:23:43.057 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:270/600: open fd = 3 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:271/600: open fd = 3 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:272/600: open fd = 3 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.058 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:273/600: open fd = 3 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:274/600: open fd = 3 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:275/600: open fd = 3 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:276/600: open fd = 3 2024-09-13T18:23:43.059 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:277/600: open fd = 3 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:278/600: open fd = 3 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:279/600: open fd = 3 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.060 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:280/600: open fd = 3 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:281/600: open fd = 3 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:282/600: open fd = 3 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:283/600: open fd = 3 2024-09-13T18:23:43.061 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:284/600: open fd = 3 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:285/600: open fd = 3 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:286/600: open fd = 3 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.062 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:287/600: open fd = 3 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:288/600: open fd = 3 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:289/600: open fd = 3 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.063 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:290/600: open fd = 3 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:291/600: open fd = 3 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:292/600: open fd = 3 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:293/600: open fd = 3 2024-09-13T18:23:43.064 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:294/600: open fd = 3 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:295/600: open fd = 3 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:296/600: open fd = 3 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.065 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:297/600: open fd = 3 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:298/600: open fd = 3 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:299/600: open fd = 3 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.066 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:300/600: open fd = 3 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:301/600: open fd = 3 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:302/600: open fd = 3 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.067 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:303/600: open fd = 3 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:304/600: open fd = 3 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:305/600: open fd = 3 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:306/600: open fd = 3 2024-09-13T18:23:43.068 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:307/600: open fd = 3 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:308/600: open fd = 3 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:309/600: open fd = 3 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.069 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:310/600: open fd = 3 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:311/600: open fd = 3 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:312/600: open fd = 3 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:43.070 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:23:44.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:44 smithi116 ceph-mon[35109]: pgmap v545: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:23:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:44 smithi067 ceph-mon[35103]: pgmap v545: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:23:44.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:44 smithi007 ceph-mon[30588]: pgmap v545: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:23:46.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:46 smithi116 ceph-mon[35109]: pgmap v546: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:46 smithi067 ceph-mon[35103]: pgmap v546: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:46 smithi007 ceph-mon[30588]: pgmap v546: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:48.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:48 smithi116 ceph-mon[35109]: pgmap v547: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:48.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:48 smithi067 ceph-mon[35103]: pgmap v547: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:48 smithi007 ceph-mon[30588]: pgmap v547: 97 pgs: 97 active+clean; 4.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:50.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:50 smithi116 ceph-mon[35109]: pgmap v548: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:23:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:50 smithi067 ceph-mon[35103]: pgmap v548: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:23:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:50 smithi007 ceph-mon[30588]: pgmap v548: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:23:52.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:52 smithi116 ceph-mon[35109]: pgmap v549: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:52.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:52 smithi067 ceph-mon[35103]: pgmap v549: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:52 smithi007 ceph-mon[30588]: pgmap v549: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:54.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:54 smithi116 ceph-mon[35109]: pgmap v550: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:54 smithi067 ceph-mon[35103]: pgmap v550: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:54 smithi007 ceph-mon[30588]: pgmap v550: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:23:56.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:56 smithi116 ceph-mon[35109]: pgmap v551: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:56.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:56 smithi067 ceph-mon[35103]: pgmap v551: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:56.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:56 smithi007 ceph-mon[30588]: pgmap v551: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:58.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:23:58 smithi116 ceph-mon[35109]: pgmap v552: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:58.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:23:58 smithi067 ceph-mon[35103]: pgmap v552: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:23:58.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:23:58 smithi007 ceph-mon[30588]: pgmap v552: 97 pgs: 97 active+clean; 4.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:00.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:00 smithi116 ceph-mon[35109]: pgmap v553: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:00.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:00 smithi067 ceph-mon[35103]: pgmap v553: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:00.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:00 smithi007 ceph-mon[30588]: pgmap v553: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:02.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:02 smithi116 ceph-mon[35109]: pgmap v554: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:02 smithi067 ceph-mon[35103]: pgmap v554: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:02 smithi007 ceph-mon[30588]: pgmap v554: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:04 smithi116 ceph-mon[35109]: pgmap v555: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:04.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:04 smithi067 ceph-mon[35103]: pgmap v555: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:04 smithi007 ceph-mon[30588]: pgmap v555: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:06.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:06 smithi116 ceph-mon[35109]: pgmap v556: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:06.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:06 smithi067 ceph-mon[35103]: pgmap v556: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:06 smithi007 ceph-mon[30588]: pgmap v556: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:08.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:08 smithi116 ceph-mon[35109]: pgmap v557: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:08.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:08 smithi067 ceph-mon[35103]: pgmap v557: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:08 smithi007 ceph-mon[30588]: pgmap v557: 97 pgs: 97 active+clean; 4.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:10.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:10 smithi116 ceph-mon[35109]: pgmap v558: 97 pgs: 97 active+clean; 4.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-13T18:24:10.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:10 smithi067 ceph-mon[35103]: pgmap v558: 97 pgs: 97 active+clean; 4.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-13T18:24:10.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:10 smithi007 ceph-mon[30588]: pgmap v558: 97 pgs: 97 active+clean; 4.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 19 op/s 2024-09-13T18:24:12.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:12 smithi116 ceph-mon[35109]: pgmap v559: 97 pgs: 97 active+clean; 4.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:24:12.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:12 smithi067 ceph-mon[35103]: pgmap v559: 97 pgs: 97 active+clean; 4.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:24:12.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:12 smithi007 ceph-mon[30588]: pgmap v559: 97 pgs: 97 active+clean; 4.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:24:14.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:14 smithi116 ceph-mon[35109]: pgmap v560: 97 pgs: 97 active+clean; 4.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:24:14.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:14 smithi067 ceph-mon[35103]: pgmap v560: 97 pgs: 97 active+clean; 4.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:24:14.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:14 smithi007 ceph-mon[30588]: pgmap v560: 97 pgs: 97 active+clean; 4.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:24:16.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:16 smithi116 ceph-mon[35109]: pgmap v561: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:24:16.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:16 smithi067 ceph-mon[35103]: pgmap v561: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:24:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:16 smithi007 ceph-mon[30588]: pgmap v561: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 16 op/s 2024-09-13T18:24:18.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:18 smithi116 ceph-mon[35109]: pgmap v562: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-13T18:24:18.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:18 smithi067 ceph-mon[35103]: pgmap v562: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-13T18:24:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:18 smithi007 ceph-mon[30588]: pgmap v562: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-13T18:24:20.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:20 smithi116 ceph-mon[35109]: pgmap v563: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-13T18:24:20.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:20 smithi067 ceph-mon[35103]: pgmap v563: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-13T18:24:20.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:20 smithi007 ceph-mon[30588]: pgmap v563: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 20 op/s 2024-09-13T18:24:22.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:22 smithi116 ceph-mon[35109]: pgmap v564: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:22.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:22 smithi067 ceph-mon[35103]: pgmap v564: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:22.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:22 smithi007 ceph-mon[30588]: pgmap v564: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:24.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:24 smithi116 ceph-mon[35109]: pgmap v565: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:24:24.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:24 smithi067 ceph-mon[35103]: pgmap v565: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:24:24.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:24 smithi007 ceph-mon[30588]: pgmap v565: 97 pgs: 97 active+clean; 4.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-13T18:24:26.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:26 smithi116 ceph-mon[35109]: pgmap v566: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:26.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:26 smithi067 ceph-mon[35103]: pgmap v566: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:26 smithi007 ceph-mon[30588]: pgmap v566: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:28.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:28 smithi116 ceph-mon[35109]: pgmap v567: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:28 smithi067 ceph-mon[35103]: pgmap v567: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:28.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:28 smithi007 ceph-mon[30588]: pgmap v567: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:30.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:30 smithi116 ceph-mon[35109]: pgmap v568: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 19 op/s 2024-09-13T18:24:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:30 smithi067 ceph-mon[35103]: pgmap v568: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 19 op/s 2024-09-13T18:24:30.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:30 smithi007 ceph-mon[30588]: pgmap v568: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 19 op/s 2024-09-13T18:24:32.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:32 smithi116 ceph-mon[35109]: pgmap v569: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:32.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:32 smithi067 ceph-mon[35103]: pgmap v569: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:32.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:32 smithi007 ceph-mon[30588]: pgmap v569: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:34.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:34 smithi116 ceph-mon[35109]: pgmap v570: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:34.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:34 smithi067 ceph-mon[35103]: pgmap v570: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:34.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:34 smithi007 ceph-mon[30588]: pgmap v570: 97 pgs: 97 active+clean; 4.8 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:36.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:36 smithi116 ceph-mon[35109]: pgmap v571: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:24:36.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:36 smithi067 ceph-mon[35103]: pgmap v571: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:24:36.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:36 smithi007 ceph-mon[30588]: pgmap v571: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:24:37.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:37.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:24:37.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:37.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:37.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:37.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:24:37.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:37.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:37.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:24:38.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:38 smithi116 ceph-mon[35109]: pgmap v572: 97 pgs: 97 active+clean; 4.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:38.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:38 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-13T18:24:38.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:38 smithi116 ceph-mon[35109]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-13T18:24:38.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:38 smithi116 ceph-mon[35109]: Unable to set osd_memory_target on smithi116 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-13T18:24:38.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:38 smithi116 ceph-mon[35109]: Unable to set osd_memory_target on smithi067 to 184598220: error parsing value: Value '184598220' is below minimum 939524096 2024-09-13T18:24:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:38 smithi067 ceph-mon[35103]: pgmap v572: 97 pgs: 97 active+clean; 4.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:38 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-13T18:24:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:38 smithi067 ceph-mon[35103]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-13T18:24:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:38 smithi067 ceph-mon[35103]: Unable to set osd_memory_target on smithi116 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-13T18:24:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:38 smithi067 ceph-mon[35103]: Unable to set osd_memory_target on smithi067 to 184598220: error parsing value: Value '184598220' is below minimum 939524096 2024-09-13T18:24:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:38 smithi007 ceph-mon[30588]: pgmap v572: 97 pgs: 97 active+clean; 4.9 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:38 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-09-13T18:24:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:38 smithi007 ceph-mon[30588]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-13T18:24:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:38 smithi007 ceph-mon[30588]: Unable to set osd_memory_target on smithi116 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-13T18:24:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:38 smithi007 ceph-mon[30588]: Unable to set osd_memory_target on smithi067 to 184598220: error parsing value: Value '184598220' is below minimum 939524096 2024-09-13T18:24:40.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:40 smithi116 ceph-mon[35109]: pgmap v573: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:40.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:40 smithi067 ceph-mon[35103]: pgmap v573: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:40.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:40 smithi007 ceph-mon[30588]: pgmap v573: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:42 smithi067 ceph-mon[35103]: pgmap v574: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:42.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:42 smithi007 ceph-mon[30588]: pgmap v574: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:42 smithi116 ceph-mon[35109]: pgmap v574: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:44 smithi067 ceph-mon[35103]: pgmap v575: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:44.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:44 smithi007 ceph-mon[30588]: pgmap v575: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:44.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:44 smithi116 ceph-mon[35109]: pgmap v575: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:45.515 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.732 INFO:tasks.workunit.client.0.smithi007.stdout:313/600: open fd = 3 2024-09-13T18:24:45.732 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.732 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.733 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.733 INFO:tasks.workunit.client.0.smithi007.stdout:314/600: open fd = 3 2024-09-13T18:24:45.733 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.733 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.733 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.734 INFO:tasks.workunit.client.0.smithi007.stdout:315/600: open fd = 3 2024-09-13T18:24:45.734 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.734 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.735 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.735 INFO:tasks.workunit.client.0.smithi007.stdout:316/600: open fd = 3 2024-09-13T18:24:45.735 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.735 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.735 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.736 INFO:tasks.workunit.client.0.smithi007.stdout:317/600: open fd = 3 2024-09-13T18:24:45.736 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.736 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.736 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.737 INFO:tasks.workunit.client.0.smithi007.stdout:318/600: open fd = 3 2024-09-13T18:24:45.737 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.737 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.738 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.738 INFO:tasks.workunit.client.0.smithi007.stdout:319/600: open fd = 3 2024-09-13T18:24:45.738 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.739 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.739 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.739 INFO:tasks.workunit.client.0.smithi007.stdout:320/600: open fd = 3 2024-09-13T18:24:45.740 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.740 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.740 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.741 INFO:tasks.workunit.client.0.smithi007.stdout:321/600: open fd = 3 2024-09-13T18:24:45.741 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.741 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.741 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.741 INFO:tasks.workunit.client.0.smithi007.stdout:322/600: open fd = 3 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:323/600: open fd = 3 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:324/600: open fd = 3 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.742 INFO:tasks.workunit.client.0.smithi007.stdout:325/600: open fd = 3 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:326/600: open fd = 3 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:327/600: open fd = 3 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:328/600: open fd = 3 2024-09-13T18:24:45.743 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:329/600: open fd = 3 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:330/600: open fd = 3 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:331/600: open fd = 3 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.744 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:332/600: open fd = 3 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:333/600: open fd = 3 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.746 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:334/600: open fd = 3 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:335/600: open fd = 3 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:336/600: open fd = 3 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.747 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.748 INFO:tasks.workunit.client.0.smithi007.stdout:337/600: open fd = 3 2024-09-13T18:24:45.748 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.748 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.748 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.748 INFO:tasks.workunit.client.0.smithi007.stdout:338/600: open fd = 3 2024-09-13T18:24:45.748 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.749 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.749 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.749 INFO:tasks.workunit.client.0.smithi007.stdout:339/600: open fd = 3 2024-09-13T18:24:45.749 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.749 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.749 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.749 INFO:tasks.workunit.client.0.smithi007.stdout:340/600: open fd = 3 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:341/600: open fd = 3 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.750 INFO:tasks.workunit.client.0.smithi007.stdout:342/600: open fd = 3 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:343/600: open fd = 3 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.751 INFO:tasks.workunit.client.0.smithi007.stdout:344/600: open fd = 3 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:345/600: open fd = 3 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:346/600: open fd = 3 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.752 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:347/600: open fd = 3 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:348/600: open fd = 3 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:349/600: open fd = 3 2024-09-13T18:24:45.753 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:350/600: open fd = 3 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:351/600: open fd = 3 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:352/600: open fd = 3 2024-09-13T18:24:45.754 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.755 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.755 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.755 INFO:tasks.workunit.client.0.smithi007.stdout:353/600: open fd = 3 2024-09-13T18:24:45.755 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.755 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.755 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.755 INFO:tasks.workunit.client.0.smithi007.stdout:354/600: open fd = 3 2024-09-13T18:24:45.756 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.756 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.756 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.756 INFO:tasks.workunit.client.0.smithi007.stdout:355/600: open fd = 3 2024-09-13T18:24:45.756 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:356/600: open fd = 3 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:357/600: open fd = 3 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.757 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:358/600: open fd = 3 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:359/600: open fd = 3 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.758 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:360/600: open fd = 3 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:361/600: open fd = 3 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.759 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.760 INFO:tasks.workunit.client.0.smithi007.stdout:362/600: open fd = 3 2024-09-13T18:24:45.760 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.760 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.760 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.760 INFO:tasks.workunit.client.0.smithi007.stdout:363/600: open fd = 3 2024-09-13T18:24:45.760 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.760 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.761 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.761 INFO:tasks.workunit.client.0.smithi007.stdout:364/600: open fd = 3 2024-09-13T18:24:45.761 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.761 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.761 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.761 INFO:tasks.workunit.client.0.smithi007.stdout:365/600: open fd = 3 2024-09-13T18:24:45.761 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:366/600: open fd = 3 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:367/600: open fd = 3 2024-09-13T18:24:45.762 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.763 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.763 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.763 INFO:tasks.workunit.client.0.smithi007.stdout:368/600: open fd = 3 2024-09-13T18:24:45.763 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.763 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:369/600: open fd = 3 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:370/600: open fd = 3 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:371/600: open fd = 3 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.764 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:372/600: open fd = 3 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:373/600: open fd = 3 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:374/600: open fd = 3 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:24:45.765 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:24:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:46 smithi067 ceph-mon[35103]: pgmap v576: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:46 smithi007 ceph-mon[30588]: pgmap v576: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:46.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:46 smithi116 ceph-mon[35109]: pgmap v576: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:24:48.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:48 smithi067 ceph-mon[35103]: pgmap v577: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:48 smithi007 ceph-mon[30588]: pgmap v577: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:48 smithi116 ceph-mon[35109]: pgmap v577: 97 pgs: 97 active+clean; 5.0 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:50 smithi067 ceph-mon[35103]: pgmap v578: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:50 smithi007 ceph-mon[30588]: pgmap v578: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:50.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:50 smithi116 ceph-mon[35109]: pgmap v578: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:24:52.748 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:52 smithi067 ceph-mon[35103]: pgmap v579: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:52 smithi007 ceph-mon[30588]: pgmap v579: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:52.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:52 smithi116 ceph-mon[35109]: pgmap v579: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:24:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:54 smithi067 ceph-mon[35103]: pgmap v580: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:54.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:54 smithi116 ceph-mon[35109]: pgmap v580: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:54.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:54 smithi007 ceph-mon[30588]: pgmap v580: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:56.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:56 smithi067 ceph-mon[35103]: pgmap v581: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:24:56.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:56 smithi007 ceph-mon[30588]: pgmap v581: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:24:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:56 smithi116 ceph-mon[35109]: pgmap v581: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:24:58.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:24:58 smithi067 ceph-mon[35103]: pgmap v582: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:58.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:24:58 smithi007 ceph-mon[30588]: pgmap v582: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:24:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:24:58 smithi116 ceph-mon[35109]: pgmap v582: 97 pgs: 97 active+clean; 5.1 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:00.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:00 smithi067 ceph-mon[35103]: pgmap v583: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:00.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:00 smithi007 ceph-mon[30588]: pgmap v583: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:00.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:00 smithi116 ceph-mon[35109]: pgmap v583: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:02 smithi067 ceph-mon[35103]: pgmap v584: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:02.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:02 smithi007 ceph-mon[30588]: pgmap v584: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:02.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:02 smithi116 ceph-mon[35109]: pgmap v584: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:04 smithi007 ceph-mon[30588]: pgmap v585: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:04 smithi116 ceph-mon[35109]: pgmap v585: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:04 smithi067 ceph-mon[35103]: pgmap v585: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:06 smithi007 ceph-mon[30588]: pgmap v586: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:06.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:06 smithi116 ceph-mon[35109]: pgmap v586: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:06 smithi067 ceph-mon[35103]: pgmap v586: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:08 smithi007 ceph-mon[30588]: pgmap v587: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:25:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:08 smithi116 ceph-mon[35109]: pgmap v587: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:25:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:08 smithi067 ceph-mon[35103]: pgmap v587: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:25:10.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:10 smithi007 ceph-mon[30588]: pgmap v588: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:10.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:10 smithi116 ceph-mon[35109]: pgmap v588: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:10 smithi067 ceph-mon[35103]: pgmap v588: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:12.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:12 smithi007 ceph-mon[30588]: pgmap v589: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:25:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:12 smithi116 ceph-mon[35109]: pgmap v589: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:25:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:12 smithi067 ceph-mon[35103]: pgmap v589: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:25:14.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:14 smithi007 ceph-mon[30588]: pgmap v590: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:25:14.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:14 smithi116 ceph-mon[35109]: pgmap v590: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:25:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:14 smithi067 ceph-mon[35103]: pgmap v590: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:25:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:16 smithi007 ceph-mon[30588]: pgmap v591: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:16 smithi116 ceph-mon[35109]: pgmap v591: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:16 smithi067 ceph-mon[35103]: pgmap v591: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:18 smithi007 ceph-mon[30588]: pgmap v592: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:18.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:18 smithi116 ceph-mon[35109]: pgmap v592: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:18 smithi067 ceph-mon[35103]: pgmap v592: 97 pgs: 97 active+clean; 5.3 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:20.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:20 smithi007 ceph-mon[30588]: pgmap v593: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:20.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:20 smithi116 ceph-mon[35109]: pgmap v593: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:20 smithi067 ceph-mon[35103]: pgmap v593: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:22.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:22 smithi007 ceph-mon[30588]: pgmap v594: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:22.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:22 smithi116 ceph-mon[35109]: pgmap v594: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:22 smithi067 ceph-mon[35103]: pgmap v594: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:24.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:24 smithi007 ceph-mon[30588]: pgmap v595: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:24.799 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:24 smithi067 ceph-mon[35103]: pgmap v595: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:24.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:24 smithi116 ceph-mon[35109]: pgmap v595: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:26 smithi007 ceph-mon[30588]: pgmap v596: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:25:26.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:26 smithi116 ceph-mon[35109]: pgmap v596: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:25:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:26 smithi067 ceph-mon[35103]: pgmap v596: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:25:28.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:28 smithi116 ceph-mon[35109]: pgmap v597: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:28.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:28 smithi067 ceph-mon[35103]: pgmap v597: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:29.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:28 smithi007 ceph-mon[30588]: pgmap v597: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:30 smithi116 ceph-mon[35109]: pgmap v598: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:30 smithi067 ceph-mon[35103]: pgmap v598: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:30 smithi007 ceph-mon[30588]: pgmap v598: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:25:32.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:32 smithi116 ceph-mon[35109]: pgmap v599: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:32 smithi067 ceph-mon[35103]: pgmap v599: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:32 smithi007 ceph-mon[30588]: pgmap v599: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:34.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:34 smithi116 ceph-mon[35109]: pgmap v600: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:34 smithi067 ceph-mon[35103]: pgmap v600: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:34 smithi007 ceph-mon[30588]: pgmap v600: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:36.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:36 smithi116 ceph-mon[35109]: pgmap v601: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:36 smithi067 ceph-mon[35103]: pgmap v601: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:37.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:36 smithi007 ceph-mon[30588]: pgmap v601: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:37.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:37 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:37.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:37 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:38.040 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:37 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:38.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:38 smithi116 ceph-mon[35109]: pgmap v602: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:25:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:38 smithi067 ceph-mon[35103]: pgmap v602: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:25:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:38 smithi007 ceph-mon[30588]: pgmap v602: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:39.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:25:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:40 smithi116 ceph-mon[35109]: pgmap v603: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:40 smithi067 ceph-mon[35103]: pgmap v603: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:40 smithi007 ceph-mon[30588]: pgmap v603: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:42.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:42 smithi116 ceph-mon[35109]: pgmap v604: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:42 smithi067 ceph-mon[35103]: pgmap v604: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:42 smithi007 ceph-mon[30588]: pgmap v604: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:44 smithi116 ceph-mon[35109]: pgmap v605: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:44 smithi067 ceph-mon[35103]: pgmap v605: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:45.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:44 smithi007 ceph-mon[30588]: pgmap v605: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:46.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:46 smithi116 ceph-mon[35109]: pgmap v606: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:25:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:46 smithi067 ceph-mon[35103]: pgmap v606: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:25:47.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:46 smithi007 ceph-mon[30588]: pgmap v606: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:25:47.977 INFO:tasks.workunit.client.0.smithi007.stdout:375/600: open fd = 3 2024-09-13T18:25:47.977 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:376/600: open fd = 3 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:377/600: open fd = 3 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:378/600: open fd = 3 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.978 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:379/600: open fd = 3 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:380/600: open fd = 3 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:381/600: open fd = 3 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.979 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:382/600: open fd = 3 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:383/600: open fd = 3 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.980 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:384/600: open fd = 3 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:385/600: open fd = 3 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:386/600: open fd = 3 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.981 INFO:tasks.workunit.client.0.smithi007.stdout:387/600: open fd = 3 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:388/600: open fd = 3 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:389/600: open fd = 3 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.982 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:390/600: open fd = 3 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:391/600: open fd = 3 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:392/600: open fd = 3 2024-09-13T18:25:47.983 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:393/600: open fd = 3 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:394/600: open fd = 3 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.984 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:395/600: open fd = 3 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:396/600: open fd = 3 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:397/600: open fd = 3 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.985 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:398/600: open fd = 3 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:399/600: open fd = 3 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:400/600: open fd = 3 2024-09-13T18:25:47.986 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:401/600: open fd = 3 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:402/600: open fd = 3 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:403/600: open fd = 3 2024-09-13T18:25:47.987 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:404/600: open fd = 3 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:405/600: open fd = 3 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.988 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:406/600: open fd = 3 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:407/600: open fd = 3 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:408/600: open fd = 3 2024-09-13T18:25:47.989 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:409/600: open fd = 3 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:410/600: open fd = 3 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.990 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:411/600: open fd = 3 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:412/600: open fd = 3 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.991 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:413/600: open fd = 3 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:414/600: open fd = 3 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.992 INFO:tasks.workunit.client.0.smithi007.stdout:415/600: open fd = 3 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:416/600: open fd = 3 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:417/600: open fd = 3 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:418/600: open fd = 3 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.993 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:419/600: open fd = 3 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:420/600: open fd = 3 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.994 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:421/600: open fd = 3 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:422/600: open fd = 3 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:423/600: open fd = 3 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.995 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.996 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.996 INFO:tasks.workunit.client.0.smithi007.stdout:424/600: open fd = 3 2024-09-13T18:25:47.996 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.996 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.996 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.996 INFO:tasks.workunit.client.0.smithi007.stdout:425/600: open fd = 3 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:426/600: open fd = 3 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:427/600: open fd = 3 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:428/600: open fd = 3 2024-09-13T18:25:47.997 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:429/600: open fd = 3 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:430/600: open fd = 3 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:431/600: open fd = 3 2024-09-13T18:25:47.998 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:432/600: open fd = 3 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:433/600: open fd = 3 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:47.999 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:434/600: open fd = 3 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:435/600: open fd = 3 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:436/600: open fd = 3 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:25:48.000 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:25:48.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:48 smithi116 ceph-mon[35109]: pgmap v607: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:48 smithi067 ceph-mon[35103]: pgmap v607: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:49.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:48 smithi007 ceph-mon[30588]: pgmap v607: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:50.968 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:50 smithi116 ceph-mon[35109]: pgmap v608: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:51.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:50 smithi007 ceph-mon[30588]: pgmap v608: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:51.863 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:50 smithi067 ceph-mon[35103]: pgmap v608: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:25:52.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:52 smithi116 ceph-mon[35109]: pgmap v609: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:52.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:52 smithi067 ceph-mon[35103]: pgmap v609: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:53.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:52 smithi007 ceph-mon[30588]: pgmap v609: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:25:54.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:54 smithi116 ceph-mon[35109]: pgmap v610: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:54.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:54 smithi067 ceph-mon[35103]: pgmap v610: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:55.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:54 smithi007 ceph-mon[30588]: pgmap v610: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:56.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:56 smithi116 ceph-mon[35109]: pgmap v611: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:56.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:56 smithi067 ceph-mon[35103]: pgmap v611: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:57.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:56 smithi007 ceph-mon[30588]: pgmap v611: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:25:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:25:58 smithi116 ceph-mon[35109]: pgmap v612: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:58.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:25:58 smithi067 ceph-mon[35103]: pgmap v612: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:25:59.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:25:58 smithi007 ceph-mon[30588]: pgmap v612: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:00.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:00 smithi116 ceph-mon[35109]: pgmap v613: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:26:00.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:00 smithi067 ceph-mon[35103]: pgmap v613: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:26:01.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:00 smithi007 ceph-mon[30588]: pgmap v613: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:26:02.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:02 smithi116 ceph-mon[35109]: pgmap v614: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:02.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:02 smithi067 ceph-mon[35103]: pgmap v614: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:03.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:02 smithi007 ceph-mon[30588]: pgmap v614: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:04.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:04 smithi116 ceph-mon[35109]: pgmap v615: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:04 smithi067 ceph-mon[35103]: pgmap v615: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:05.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:04 smithi007 ceph-mon[30588]: pgmap v615: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:06.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:06 smithi116 ceph-mon[35109]: pgmap v616: 97 pgs: 97 active+clean; 5.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:26:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:06 smithi067 ceph-mon[35103]: pgmap v616: 97 pgs: 97 active+clean; 5.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:26:07.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:06 smithi007 ceph-mon[30588]: pgmap v616: 97 pgs: 97 active+clean; 5.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:26:08.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:08 smithi116 ceph-mon[35109]: pgmap v617: 97 pgs: 97 active+clean; 5.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:08 smithi067 ceph-mon[35103]: pgmap v617: 97 pgs: 97 active+clean; 5.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:09.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:08 smithi007 ceph-mon[30588]: pgmap v617: 97 pgs: 97 active+clean; 5.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:10.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:10 smithi116 ceph-mon[35109]: pgmap v618: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:10 smithi067 ceph-mon[35103]: pgmap v618: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:11.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:10 smithi007 ceph-mon[30588]: pgmap v618: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:12 smithi116 ceph-mon[35109]: pgmap v619: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:12 smithi067 ceph-mon[35103]: pgmap v619: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:13.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:12 smithi007 ceph-mon[30588]: pgmap v619: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:14 smithi116 ceph-mon[35109]: pgmap v620: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:14 smithi067 ceph-mon[35103]: pgmap v620: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:15.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:14 smithi007 ceph-mon[30588]: pgmap v620: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:16.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:16 smithi116 ceph-mon[35109]: pgmap v621: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:16 smithi067 ceph-mon[35103]: pgmap v621: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:17.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:16 smithi007 ceph-mon[30588]: pgmap v621: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:18.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:18 smithi116 ceph-mon[35109]: pgmap v622: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:18.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:18 smithi067 ceph-mon[35103]: pgmap v622: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:19.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:18 smithi007 ceph-mon[30588]: pgmap v622: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:20.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:20 smithi116 ceph-mon[35109]: pgmap v623: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 19 op/s 2024-09-13T18:26:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:20 smithi067 ceph-mon[35103]: pgmap v623: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 19 op/s 2024-09-13T18:26:21.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:20 smithi007 ceph-mon[30588]: pgmap v623: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 19 op/s 2024-09-13T18:26:22.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:22 smithi116 ceph-mon[35109]: pgmap v624: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:26:22.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:22 smithi067 ceph-mon[35103]: pgmap v624: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:26:23.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:22 smithi007 ceph-mon[30588]: pgmap v624: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-13T18:26:24.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:24 smithi116 ceph-mon[35109]: pgmap v625: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-13T18:26:24.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:24 smithi067 ceph-mon[35103]: pgmap v625: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-13T18:26:25.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:24 smithi007 ceph-mon[30588]: pgmap v625: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-13T18:26:26.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:26 smithi116 ceph-mon[35109]: pgmap v626: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:26.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:26 smithi067 ceph-mon[35103]: pgmap v626: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:27.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:26 smithi007 ceph-mon[30588]: pgmap v626: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:28.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:28 smithi116 ceph-mon[35109]: pgmap v627: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:28.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:28 smithi067 ceph-mon[35103]: pgmap v627: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:29.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:28 smithi007 ceph-mon[30588]: pgmap v627: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:30.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:30 smithi116 ceph-mon[35109]: pgmap v628: 97 pgs: 97 active+clean; 6.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:30.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:30 smithi067 ceph-mon[35103]: pgmap v628: 97 pgs: 97 active+clean; 6.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:31.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:30 smithi007 ceph-mon[30588]: pgmap v628: 97 pgs: 97 active+clean; 6.2 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:32.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:32 smithi116 ceph-mon[35109]: pgmap v629: 97 pgs: 97 active+clean; 6.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:32.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:32 smithi067 ceph-mon[35103]: pgmap v629: 97 pgs: 97 active+clean; 6.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:33.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:32 smithi007 ceph-mon[30588]: pgmap v629: 97 pgs: 97 active+clean; 6.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:34.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:34 smithi116 ceph-mon[35109]: pgmap v630: 97 pgs: 97 active+clean; 6.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:34.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:34 smithi067 ceph-mon[35103]: pgmap v630: 97 pgs: 97 active+clean; 6.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:35.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:34 smithi007 ceph-mon[30588]: pgmap v630: 97 pgs: 97 active+clean; 6.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:36.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:36 smithi116 ceph-mon[35109]: pgmap v631: 97 pgs: 97 active+clean; 6.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:26:36.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:36 smithi067 ceph-mon[35103]: pgmap v631: 97 pgs: 97 active+clean; 6.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:26:37.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:36 smithi007 ceph-mon[30588]: pgmap v631: 97 pgs: 97 active+clean; 6.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:26:38.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:38 smithi116 ceph-mon[35109]: pgmap v632: 97 pgs: 97 active+clean; 6.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:38.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:38 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:38 smithi067 ceph-mon[35103]: pgmap v632: 97 pgs: 97 active+clean; 6.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:38.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:38 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:38 smithi007 ceph-mon[30588]: pgmap v632: 97 pgs: 97 active+clean; 6.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:39.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:38 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:39.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:39.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:39.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:26:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:39.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:26:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:26:40.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:40 smithi116 ceph-mon[35109]: pgmap v633: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:40.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:40 smithi067 ceph-mon[35103]: pgmap v633: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:41.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:40 smithi007 ceph-mon[30588]: pgmap v633: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:26:42.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:42 smithi116 ceph-mon[35109]: pgmap v634: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:42.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:42 smithi067 ceph-mon[35103]: pgmap v634: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:43.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:42 smithi007 ceph-mon[30588]: pgmap v634: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:44.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:44 smithi116 ceph-mon[35109]: pgmap v635: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:44.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:44 smithi067 ceph-mon[35103]: pgmap v635: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:45.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:44 smithi007 ceph-mon[30588]: pgmap v635: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:46.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:46 smithi116 ceph-mon[35109]: pgmap v636: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:46.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:46 smithi067 ceph-mon[35103]: pgmap v636: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:47.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:46 smithi007 ceph-mon[30588]: pgmap v636: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:48.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:48 smithi116 ceph-mon[35109]: pgmap v637: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:48.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:48 smithi067 ceph-mon[35103]: pgmap v637: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:49.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:48 smithi007 ceph-mon[30588]: pgmap v637: 97 pgs: 97 active+clean; 6.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:49.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:49 smithi067 ceph-mon[35103]: pgmap v638: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:26:50.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:49 smithi007 ceph-mon[30588]: pgmap v638: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:26:50.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:49 smithi116 ceph-mon[35109]: pgmap v638: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:26:50.446 INFO:tasks.workunit.client.0.smithi007.stdout:437/600: open fd = 3 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:438/600: open fd = 3 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:439/600: open fd = 3 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.447 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:440/600: open fd = 3 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:441/600: open fd = 3 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:442/600: open fd = 3 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.448 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:443/600: open fd = 3 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:444/600: open fd = 3 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:445/600: open fd = 3 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.449 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:446/600: open fd = 3 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:447/600: open fd = 3 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:448/600: open fd = 3 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.450 INFO:tasks.workunit.client.0.smithi007.stdout:449/600: open fd = 3 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:450/600: open fd = 3 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:451/600: open fd = 3 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.451 INFO:tasks.workunit.client.0.smithi007.stdout:452/600: open fd = 3 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:453/600: open fd = 3 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:454/600: open fd = 3 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:455/600: open fd = 3 2024-09-13T18:26:50.452 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:456/600: open fd = 3 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:457/600: open fd = 3 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.453 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:458/600: open fd = 3 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:459/600: open fd = 3 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:460/600: open fd = 3 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.454 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:461/600: open fd = 3 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:462/600: open fd = 3 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:463/600: open fd = 3 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:464/600: open fd = 3 2024-09-13T18:26:50.455 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:465/600: open fd = 3 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:466/600: open fd = 3 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:467/600: open fd = 3 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.456 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:468/600: open fd = 3 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:469/600: open fd = 3 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:470/600: open fd = 3 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.457 INFO:tasks.workunit.client.0.smithi007.stdout:471/600: open fd = 3 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:472/600: open fd = 3 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:473/600: open fd = 3 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:474/600: open fd = 3 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.458 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:475/600: open fd = 3 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:476/600: open fd = 3 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:477/600: open fd = 3 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.459 INFO:tasks.workunit.client.0.smithi007.stdout:478/600: open fd = 3 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:479/600: open fd = 3 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:480/600: open fd = 3 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:481/600: open fd = 3 2024-09-13T18:26:50.460 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:482/600: open fd = 3 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:483/600: open fd = 3 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:484/600: open fd = 3 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.461 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:485/600: open fd = 3 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:486/600: open fd = 3 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:487/600: open fd = 3 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.462 INFO:tasks.workunit.client.0.smithi007.stdout:488/600: open fd = 3 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:489/600: open fd = 3 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:490/600: open fd = 3 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.463 INFO:tasks.workunit.client.0.smithi007.stdout:491/600: open fd = 3 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:492/600: open fd = 3 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:493/600: open fd = 3 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:494/600: open fd = 3 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.464 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:495/600: open fd = 3 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:496/600: open fd = 3 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:497/600: open fd = 3 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.465 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:50.466 INFO:tasks.workunit.client.0.smithi007.stdout:498/600: open fd = 3 2024-09-13T18:26:50.466 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.466 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:26:50.466 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:26:52.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:51 smithi007 ceph-mon[30588]: pgmap v639: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:52.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:51 smithi116 ceph-mon[35109]: pgmap v639: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:52.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:51 smithi067 ceph-mon[35103]: pgmap v639: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:26:54.013 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:53 smithi116 ceph-mon[35109]: pgmap v640: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:54.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:53 smithi007 ceph-mon[30588]: pgmap v640: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:54.047 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:53 smithi067 ceph-mon[35103]: pgmap v640: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:56.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:55 smithi007 ceph-mon[30588]: pgmap v641: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:56.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:55 smithi116 ceph-mon[35109]: pgmap v641: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:56.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:55 smithi067 ceph-mon[35103]: pgmap v641: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:26:58.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:57 smithi007 ceph-mon[30588]: pgmap v642: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:58.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:57 smithi116 ceph-mon[35109]: pgmap v642: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:26:58.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:57 smithi067 ceph-mon[35103]: pgmap v642: 97 pgs: 97 active+clean; 6.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:00.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:26:59 smithi007 ceph-mon[30588]: pgmap v643: 97 pgs: 97 active+clean; 6.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:00.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:26:59 smithi116 ceph-mon[35109]: pgmap v643: 97 pgs: 97 active+clean; 6.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:00.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:26:59 smithi067 ceph-mon[35103]: pgmap v643: 97 pgs: 97 active+clean; 6.6 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:02.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:01 smithi007 ceph-mon[30588]: pgmap v644: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:02.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:01 smithi116 ceph-mon[35109]: pgmap v644: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:02.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:01 smithi067 ceph-mon[35103]: pgmap v644: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:04.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:03 smithi007 ceph-mon[30588]: pgmap v645: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:04.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:03 smithi116 ceph-mon[35109]: pgmap v645: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:04.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:03 smithi067 ceph-mon[35103]: pgmap v645: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:06.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:05 smithi007 ceph-mon[30588]: pgmap v646: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:27:06.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:05 smithi116 ceph-mon[35109]: pgmap v646: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:27:06.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:05 smithi067 ceph-mon[35103]: pgmap v646: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:27:08.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:07 smithi007 ceph-mon[30588]: pgmap v647: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:08.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:07 smithi116 ceph-mon[35109]: pgmap v647: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:08.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:07 smithi067 ceph-mon[35103]: pgmap v647: 97 pgs: 97 active+clean; 6.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:10.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:09 smithi116 ceph-mon[35109]: pgmap v648: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:10.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:09 smithi067 ceph-mon[35103]: pgmap v648: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:10.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:09 smithi007 ceph-mon[30588]: pgmap v648: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:12.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:11 smithi116 ceph-mon[35109]: pgmap v649: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:12.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:11 smithi067 ceph-mon[35103]: pgmap v649: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:12.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:11 smithi007 ceph-mon[30588]: pgmap v649: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:14.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:13 smithi116 ceph-mon[35109]: pgmap v650: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:14.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:13 smithi067 ceph-mon[35103]: pgmap v650: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:14.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:13 smithi007 ceph-mon[30588]: pgmap v650: 97 pgs: 97 active+clean; 6.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:16.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:15 smithi116 ceph-mon[35109]: pgmap v651: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:16.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:15 smithi067 ceph-mon[35103]: pgmap v651: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:16.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:15 smithi007 ceph-mon[30588]: pgmap v651: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:18.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:17 smithi116 ceph-mon[35109]: pgmap v652: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:18.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:17 smithi067 ceph-mon[35103]: pgmap v652: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:18.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:17 smithi007 ceph-mon[30588]: pgmap v652: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:20.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:19 smithi116 ceph-mon[35109]: pgmap v653: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:20.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:19 smithi067 ceph-mon[35103]: pgmap v653: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:20.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:19 smithi007 ceph-mon[30588]: pgmap v653: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:22.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:21 smithi116 ceph-mon[35109]: pgmap v654: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:27:22.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:21 smithi067 ceph-mon[35103]: pgmap v654: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:27:22.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:21 smithi007 ceph-mon[30588]: pgmap v654: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-13T18:27:24.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:23 smithi116 ceph-mon[35109]: pgmap v655: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:27:24.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:23 smithi067 ceph-mon[35103]: pgmap v655: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:27:24.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:23 smithi007 ceph-mon[30588]: pgmap v655: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:27:26.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:25 smithi116 ceph-mon[35109]: pgmap v656: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:27:26.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:25 smithi067 ceph-mon[35103]: pgmap v656: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:27:26.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:25 smithi007 ceph-mon[30588]: pgmap v656: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:27:28.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:27 smithi116 ceph-mon[35109]: pgmap v657: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:27:28.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:27 smithi067 ceph-mon[35103]: pgmap v657: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:27:28.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:27 smithi007 ceph-mon[30588]: pgmap v657: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-13T18:27:30.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:29 smithi116 ceph-mon[35109]: pgmap v658: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-09-13T18:27:30.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:29 smithi067 ceph-mon[35103]: pgmap v658: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-09-13T18:27:30.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:29 smithi007 ceph-mon[30588]: pgmap v658: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-09-13T18:27:32.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:31 smithi116 ceph-mon[35109]: pgmap v659: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:32.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:31 smithi067 ceph-mon[35103]: pgmap v659: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:32.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:31 smithi007 ceph-mon[30588]: pgmap v659: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:34.211 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:33 smithi116 ceph-mon[35109]: pgmap v660: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:34.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:33 smithi067 ceph-mon[35103]: pgmap v660: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:34.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:33 smithi007 ceph-mon[30588]: pgmap v660: 97 pgs: 97 active+clean; 6.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:36.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:35 smithi116 ceph-mon[35109]: pgmap v661: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:27:36.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:35 smithi067 ceph-mon[35103]: pgmap v661: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:27:36.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:35 smithi007 ceph-mon[30588]: pgmap v661: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:27:38.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:37 smithi116 ceph-mon[35109]: pgmap v662: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:38.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:37 smithi067 ceph-mon[35103]: pgmap v662: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:38.291 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:37 smithi007 ceph-mon[30588]: pgmap v662: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:39 smithi007 ceph-mon[30588]: pgmap v663: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:40.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:39 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:40.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:39 smithi116 ceph-mon[35109]: pgmap v663: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:40.210 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:39 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:40.246 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:39 smithi067 ceph-mon[35103]: pgmap v663: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:27:40.247 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:39 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:41 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:41 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:41.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:41 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:42 smithi116 ceph-mon[35109]: pgmap v664: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:27:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:42 smithi067 ceph-mon[35103]: pgmap v664: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:27:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:42.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:42 smithi007 ceph-mon[30588]: pgmap v664: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:42.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:42.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:27:42.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:27:44.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:44 smithi116 ceph-mon[35109]: pgmap v665: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:44 smithi067 ceph-mon[35103]: pgmap v665: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:44.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:44 smithi007 ceph-mon[30588]: pgmap v665: 97 pgs: 97 active+clean; 7.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:46.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:46 smithi116 ceph-mon[35109]: pgmap v666: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:46 smithi067 ceph-mon[35103]: pgmap v666: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:46 smithi007 ceph-mon[30588]: pgmap v666: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:48.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:48 smithi116 ceph-mon[35109]: pgmap v667: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:48.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:48 smithi067 ceph-mon[35103]: pgmap v667: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:48.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:48 smithi007 ceph-mon[30588]: pgmap v667: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:50.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:50 smithi116 ceph-mon[35109]: pgmap v668: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:27:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:50 smithi067 ceph-mon[35103]: pgmap v668: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:27:50.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:50 smithi007 ceph-mon[30588]: pgmap v668: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:27:52.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:52 smithi116 ceph-mon[35109]: pgmap v669: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:52.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:52 smithi067 ceph-mon[35103]: pgmap v669: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:52 smithi007 ceph-mon[30588]: pgmap v669: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:27:52.912 INFO:tasks.workunit.client.0.smithi007.stdout:499/600: open fd = 3 2024-09-13T18:27:52.912 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.912 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.912 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.912 INFO:tasks.workunit.client.0.smithi007.stdout:500/600: open fd = 3 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:501/600: open fd = 3 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:502/600: open fd = 3 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.913 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:503/600: open fd = 3 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:504/600: open fd = 3 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.914 INFO:tasks.workunit.client.0.smithi007.stdout:505/600: open fd = 3 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:506/600: open fd = 3 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:507/600: open fd = 3 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.915 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:508/600: open fd = 3 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:509/600: open fd = 3 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:510/600: open fd = 3 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.916 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:511/600: open fd = 3 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:512/600: open fd = 3 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.917 INFO:tasks.workunit.client.0.smithi007.stdout:513/600: open fd = 3 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:514/600: open fd = 3 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:515/600: open fd = 3 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.918 INFO:tasks.workunit.client.0.smithi007.stdout:516/600: open fd = 3 2024-09-13T18:27:52.919 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.919 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.919 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.919 INFO:tasks.workunit.client.0.smithi007.stdout:517/600: open fd = 3 2024-09-13T18:27:52.919 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.919 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.919 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:518/600: open fd = 3 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:519/600: open fd = 3 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:520/600: open fd = 3 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.920 INFO:tasks.workunit.client.0.smithi007.stdout:521/600: open fd = 3 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:522/600: open fd = 3 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:523/600: open fd = 3 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:524/600: open fd = 3 2024-09-13T18:27:52.921 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:525/600: open fd = 3 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:526/600: open fd = 3 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:527/600: open fd = 3 2024-09-13T18:27:52.922 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:528/600: open fd = 3 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:529/600: open fd = 3 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.923 INFO:tasks.workunit.client.0.smithi007.stdout:530/600: open fd = 3 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:531/600: open fd = 3 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.924 INFO:tasks.workunit.client.0.smithi007.stdout:532/600: open fd = 3 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:533/600: open fd = 3 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:534/600: open fd = 3 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.925 INFO:tasks.workunit.client.0.smithi007.stdout:535/600: open fd = 3 2024-09-13T18:27:52.926 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.926 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.926 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.926 INFO:tasks.workunit.client.0.smithi007.stdout:536/600: open fd = 3 2024-09-13T18:27:52.926 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.926 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.926 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:537/600: open fd = 3 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:538/600: open fd = 3 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:539/600: open fd = 3 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.927 INFO:tasks.workunit.client.0.smithi007.stdout:540/600: open fd = 3 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:541/600: open fd = 3 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:542/600: open fd = 3 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:543/600: open fd = 3 2024-09-13T18:27:52.928 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:544/600: open fd = 3 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:545/600: open fd = 3 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:546/600: open fd = 3 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.929 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:547/600: open fd = 3 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:548/600: open fd = 3 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:549/600: open fd = 3 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.930 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:550/600: open fd = 3 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:551/600: open fd = 3 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:552/600: open fd = 3 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.931 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:553/600: open fd = 3 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:554/600: open fd = 3 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:555/600: open fd = 3 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.932 INFO:tasks.workunit.client.0.smithi007.stdout:556/600: open fd = 3 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:557/600: open fd = 3 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:558/600: open fd = 3 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:559/600: open fd = 3 2024-09-13T18:27:52.933 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.934 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.934 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:52.934 INFO:tasks.workunit.client.0.smithi007.stdout:560/600: open fd = 3 2024-09-13T18:27:52.934 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.934 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:27:52.934 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:27:54.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:54 smithi116 ceph-mon[35109]: pgmap v670: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:54.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:54 smithi067 ceph-mon[35103]: pgmap v670: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:54 smithi007 ceph-mon[30588]: pgmap v670: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:56.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:56 smithi116 ceph-mon[35109]: pgmap v671: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:56.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:56 smithi067 ceph-mon[35103]: pgmap v671: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:56.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:56 smithi007 ceph-mon[30588]: pgmap v671: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:27:58.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:27:58 smithi116 ceph-mon[35109]: pgmap v672: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:58.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:27:58 smithi067 ceph-mon[35103]: pgmap v672: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:27:58.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:27:58 smithi007 ceph-mon[30588]: pgmap v672: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:00.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:00 smithi116 ceph-mon[35109]: pgmap v673: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:00.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:00 smithi067 ceph-mon[35103]: pgmap v673: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:00.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:00 smithi007 ceph-mon[30588]: pgmap v673: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:02.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:02 smithi116 ceph-mon[35109]: pgmap v674: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:02.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:02 smithi067 ceph-mon[35103]: pgmap v674: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:02.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:02 smithi007 ceph-mon[30588]: pgmap v674: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:04.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:04 smithi116 ceph-mon[35109]: pgmap v675: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:04.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:04 smithi067 ceph-mon[35103]: pgmap v675: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:04 smithi007 ceph-mon[30588]: pgmap v675: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:06.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:06 smithi116 ceph-mon[35109]: pgmap v676: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:28:06.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:06 smithi067 ceph-mon[35103]: pgmap v676: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:28:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:06 smithi007 ceph-mon[30588]: pgmap v676: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-13T18:28:08.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:08 smithi116 ceph-mon[35109]: pgmap v677: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:08.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:08 smithi067 ceph-mon[35103]: pgmap v677: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:08 smithi007 ceph-mon[30588]: pgmap v677: 97 pgs: 97 active+clean; 7.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:10.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:10 smithi116 ceph-mon[35109]: pgmap v678: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:10.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:10 smithi067 ceph-mon[35103]: pgmap v678: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:10.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:10 smithi007 ceph-mon[30588]: pgmap v678: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:12.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:12 smithi116 ceph-mon[35109]: pgmap v679: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:12.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:12 smithi067 ceph-mon[35103]: pgmap v679: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:12.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:12 smithi007 ceph-mon[30588]: pgmap v679: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:14.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:14 smithi116 ceph-mon[35109]: pgmap v680: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:14.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:14 smithi067 ceph-mon[35103]: pgmap v680: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:14.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:14 smithi007 ceph-mon[30588]: pgmap v680: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:16.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:16 smithi116 ceph-mon[35109]: pgmap v681: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:28:16.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:16 smithi067 ceph-mon[35103]: pgmap v681: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:28:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:16 smithi007 ceph-mon[30588]: pgmap v681: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:28:18.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:18 smithi116 ceph-mon[35109]: pgmap v682: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:18.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:18 smithi067 ceph-mon[35103]: pgmap v682: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:18.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:18 smithi007 ceph-mon[30588]: pgmap v682: 97 pgs: 97 active+clean; 7.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:20.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:20 smithi116 ceph-mon[35109]: pgmap v683: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:28:20.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:20 smithi067 ceph-mon[35103]: pgmap v683: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:28:20.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:20 smithi007 ceph-mon[30588]: pgmap v683: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-13T18:28:22.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:22 smithi116 ceph-mon[35109]: pgmap v684: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:22.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:22 smithi067 ceph-mon[35103]: pgmap v684: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:22.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:22 smithi007 ceph-mon[30588]: pgmap v684: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:24.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:24 smithi116 ceph-mon[35109]: pgmap v685: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:24.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:24 smithi067 ceph-mon[35103]: pgmap v685: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:24.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:24 smithi007 ceph-mon[30588]: pgmap v685: 97 pgs: 97 active+clean; 7.5 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:26.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:26 smithi116 ceph-mon[35109]: pgmap v686: 97 pgs: 97 active+clean; 7.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:28:26.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:26 smithi067 ceph-mon[35103]: pgmap v686: 97 pgs: 97 active+clean; 7.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:28:26.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:26 smithi007 ceph-mon[30588]: pgmap v686: 97 pgs: 97 active+clean; 7.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-13T18:28:28.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:28 smithi116 ceph-mon[35109]: pgmap v687: 97 pgs: 97 active+clean; 7.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:28.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:28 smithi067 ceph-mon[35103]: pgmap v687: 97 pgs: 97 active+clean; 7.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:28.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:28 smithi007 ceph-mon[30588]: pgmap v687: 97 pgs: 97 active+clean; 7.6 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:30.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:30 smithi116 ceph-mon[35109]: pgmap v688: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:30.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:30 smithi067 ceph-mon[35103]: pgmap v688: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:30.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:30 smithi007 ceph-mon[30588]: pgmap v688: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-13T18:28:32.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:32 smithi116 ceph-mon[35109]: pgmap v689: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:32.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:32 smithi067 ceph-mon[35103]: pgmap v689: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:32.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:32 smithi007 ceph-mon[30588]: pgmap v689: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-13T18:28:33.209 INFO:tasks.workunit.client.0.smithi007.stdout:561/600: open fd = 3 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:562/600: open fd = 3 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:563/600: open fd = 3 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.210 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:564/600: open fd = 3 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:565/600: open fd = 3 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:566/600: open fd = 3 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:567/600: open fd = 3 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.211 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:568/600: open fd = 3 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:569/600: open fd = 3 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:570/600: open fd = 3 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:571/600: open fd = 3 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.212 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:572/600: open fd = 3 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:573/600: open fd = 3 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.213 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:574/600: open fd = 3 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:575/600: open fd = 3 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:576/600: open fd = 3 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:577/600: open fd = 3 2024-09-13T18:28:33.214 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:578/600: open fd = 3 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:579/600: open fd = 3 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:580/600: open fd = 3 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.215 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:581/600: open fd = 3 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:582/600: open fd = 3 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:583/600: open fd = 3 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:584/600: open fd = 3 2024-09-13T18:28:33.216 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:585/600: open fd = 3 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:586/600: open fd = 3 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:587/600: open fd = 3 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.217 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:588/600: open fd = 3 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:589/600: open fd = 3 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:590/600: open fd = 3 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:591/600: open fd = 3 2024-09-13T18:28:33.218 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:592/600: open fd = 3 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:593/600: open fd = 3 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:594/600: open fd = 3 2024-09-13T18:28:33.219 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:595/600: open fd = 3 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:596/600: open fd = 3 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:597/600: open fd = 3 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.220 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:598/600: open fd = 3 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:599/600: open fd = 3 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:600/600: open fd = 3 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:write ret = 32 2024-09-13T18:28:33.221 INFO:tasks.workunit.client.0.smithi007.stdout:pread ret = 64 2024-09-13T18:28:33.222 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo OK 2024-09-13T18:28:33.223 INFO:tasks.workunit.client.0.smithi007.stdout:OK 2024-09-13T18:28:33.224 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:28:33.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:28:33.302 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-13T18:28:33.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:28:34.345 DEBUG:teuthology.parallel:result is None 2024-09-13T18:28:34.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:28:34.408 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:28:34.409 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-13T18:28:34.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:34.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 -- 172.21.15.7:0/1078383310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0102ff0 msgr2=0x7fbfe0103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/1078383310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0102ff0 0x7fbfe0103470 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009900 tx=0x7fbfc802a410 comp rx=0 tx=0).stop 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 -- 172.21.15.7:0/1078383310 shutdown_connections 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/1078383310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe01039b0 0x7fbfe010a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/1078383310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0102ff0 0x7fbfe0103470 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/1078383310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe0101e00 0x7fbfe0102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 -- 172.21.15.7:0/1078383310 >> 172.21.15.7:0/1078383310 conn(0x7fbfe00fd580 msgr2=0x7fbfe00ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 -- 172.21.15.7:0/1078383310 shutdown_connections 2024-09-13T18:28:34.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.577+0000 7fbfdfe00640 1 -- 172.21.15.7:0/1078383310 wait complete. 2024-09-13T18:28:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 Processor -- start 2024-09-13T18:28:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 -- start start 2024-09-13T18:28:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0101e00 0x7fbfe0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe0102ff0 0x7fbfe0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe01039b0 0x7fbfe019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe019f8a0 con 0x7fbfe0101e00 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe019fa10 con 0x7fbfe0102ff0 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.578+0000 7fbfdfe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe019fbd0 con 0x7fbfe01039b0 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0101e00 0x7fbfe0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0101e00 0x7fbfe0197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60788/0 (socket says 172.21.15.7:60788) 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 -- 172.21.15.7:0/593252446 learned_addr learned my addr 172.21.15.7:0/593252446 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfd7e00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe0102ff0 0x7fbfe0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdf400640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe01039b0 0x7fbfe019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 -- 172.21.15.7:0/593252446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe01039b0 msgr2=0x7fbfe019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe01039b0 0x7fbfe019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 -- 172.21.15.7:0/593252446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe0102ff0 msgr2=0x7fbfe0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe0102ff0 0x7fbfe0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 -- 172.21.15.7:0/593252446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc8009560 con 0x7fbfe0101e00 2024-09-13T18:28:34.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfdea00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0101e00 0x7fbfe0197dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000d950 tx=0x7fbfd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.579+0000 7fbfe4a00640 1 -- 172.21.15.7:0/593252446 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0009c30 con 0x7fbfe0101e00 2024-09-13T18:28:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.580+0000 7fbfe4a00640 1 -- 172.21.15.7:0/593252446 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbfd0009d90 con 0x7fbfe0101e00 2024-09-13T18:28:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.580+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe019feb0 con 0x7fbfe0101e00 2024-09-13T18:28:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.580+0000 7fbfe4a00640 1 -- 172.21.15.7:0/593252446 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000f7e0 con 0x7fbfe0101e00 2024-09-13T18:28:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.580+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe01a02e0 con 0x7fbfe0101e00 2024-09-13T18:28:34.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.581+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe01092e0 con 0x7fbfe0101e00 2024-09-13T18:28:34.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.583+0000 7fbfe4a00640 1 -- 172.21.15.7:0/593252446 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fbfd0010460 con 0x7fbfe0101e00 2024-09-13T18:28:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.585+0000 7fbfe4a00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbfc40a1110 0x7fbfc40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.585+0000 7fbfe4a00640 1 -- 172.21.15.7:0/593252446 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbfd00cc5b0 con 0x7fbfe0101e00 2024-09-13T18:28:34.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.585+0000 7fbfd7e00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbfc40a1110 0x7fbfc40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.586+0000 7fbfd7e00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbfc40a1110 0x7fbfc40a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbfc802aa00 tx=0x7fbfc80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.589+0000 7fbfe4a00640 1 -- 172.21.15.7:0/593252446 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbfd0095c60 con 0x7fbfe0101e00 2024-09-13T18:28:34.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:34 smithi116 ceph-mon[35109]: pgmap v690: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:34.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:34 smithi067 ceph-mon[35103]: pgmap v690: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:34.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.770+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfe002c480 con 0x7fbfe0101e00 2024-09-13T18:28:34.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.772+0000 7fbfe4a00640 1 -- 172.21.15.7:0/593252446 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7fbfd0097b90 con 0x7fbfe0101e00 2024-09-13T18:28:34.774 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:28:34.775 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:34.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbfc40a1110 msgr2=0x7fbfc40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbfc40a1110 0x7fbfc40a35d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbfc802aa00 tx=0x7fbfc80314a0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0101e00 msgr2=0x7fbfe0197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0101e00 0x7fbfe0197dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000d950 tx=0x7fbfd000de10 comp rx=0 tx=0).stop 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 shutdown_connections 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fbfc40a1110 0x7fbfc40a35d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe01039b0 0x7fbfe019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfe0102ff0 0x7fbfe0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 --2- 172.21.15.7:0/593252446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfe0101e00 0x7fbfe0197dc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 >> 172.21.15.7:0/593252446 conn(0x7fbfe00fd580 msgr2=0x7fbfe01064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 shutdown_connections 2024-09-13T18:28:34.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.774+0000 7fbfdfe00640 1 -- 172.21.15.7:0/593252446 wait complete. 2024-09-13T18:28:34.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:34 smithi007 ceph-mon[30588]: pgmap v690: 97 pgs: 97 active+clean; 7.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:34.793 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:15:04.217247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:15:05.500183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:34.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:34.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 -- 172.21.15.7:0/3252447646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e8101fd0 msgr2=0x7fe7e81023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 --2- 172.21.15.7:0/3252447646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e8101fd0 0x7fe7e81023d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009900 tx=0x7fe7d802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 -- 172.21.15.7:0/3252447646 shutdown_connections 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 --2- 172.21.15.7:0/3252447646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8103b80 0x7fe7e810a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 --2- 172.21.15.7:0/3252447646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e81031c0 0x7fe7e8103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 --2- 172.21.15.7:0/3252447646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e8101fd0 0x7fe7e81023d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 -- 172.21.15.7:0/3252447646 >> 172.21.15.7:0/3252447646 conn(0x7fe7e80fd730 msgr2=0x7fe7e80ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 -- 172.21.15.7:0/3252447646 shutdown_connections 2024-09-13T18:28:34.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.953+0000 7fe7ed000640 1 -- 172.21.15.7:0/3252447646 wait complete. 2024-09-13T18:28:34.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 Processor -- start 2024-09-13T18:28:34.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 -- start start 2024-09-13T18:28:34.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e8101fd0 0x7fe7e8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e81031c0 0x7fe7e8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8103b80 0x7fe7e819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e819fab0 con 0x7fe7e8101fd0 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e819fc20 con 0x7fe7e8103b80 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.954+0000 7fe7ed000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e819fde0 con 0x7fe7e81031c0 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e8101fd0 0x7fe7e8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e8101fd0 0x7fe7e8197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60802/0 (socket says 172.21.15.7:60802) 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 -- 172.21.15.7:0/983036960 learned_addr learned my addr 172.21.15.7:0/983036960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7dfe00640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e81031c0 0x7fe7e8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e6800640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8103b80 0x7fe7e819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 -- 172.21.15.7:0/983036960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e81031c0 msgr2=0x7fe7e8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e81031c0 0x7fe7e8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 -- 172.21.15.7:0/983036960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8103b80 msgr2=0x7fe7e819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8103b80 0x7fe7e819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 -- 172.21.15.7:0/983036960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0009490 con 0x7fe7e8101fd0 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.955+0000 7fe7e5e00640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e8101fd0 0x7fe7e8197fc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8031500 tx=0x7fe7d8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.956+0000 7fe7dea00640 1 -- 172.21.15.7:0/983036960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8003e00 con 0x7fe7e8101fd0 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.956+0000 7fe7dea00640 1 -- 172.21.15.7:0/983036960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7d8031c70 con 0x7fe7e8101fd0 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.956+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d8009560 con 0x7fe7e8101fd0 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.956+0000 7fe7dea00640 1 -- 172.21.15.7:0/983036960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d803bc20 con 0x7fe7e8101fd0 2024-09-13T18:28:34.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.956+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e81a0380 con 0x7fe7e8101fd0 2024-09-13T18:28:34.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.957+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e8109410 con 0x7fe7e8101fd0 2024-09-13T18:28:34.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.959+0000 7fe7dea00640 1 -- 172.21.15.7:0/983036960 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fe7d80317b0 con 0x7fe7e8101fd0 2024-09-13T18:28:34.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.960+0000 7fe7dea00640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7cc0a1090 0x7fe7cc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.960+0000 7fe7dea00640 1 -- 172.21.15.7:0/983036960 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe7d80ed120 con 0x7fe7e8101fd0 2024-09-13T18:28:34.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.960+0000 7fe7dfe00640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7cc0a1090 0x7fe7cc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.961+0000 7fe7dfe00640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7cc0a1090 0x7fe7cc0a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe7e81994d0 tx=0x7fe7d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:34.964+0000 7fe7dea00640 1 -- 172.21.15.7:0/983036960 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe7d80b6910 con 0x7fe7e8101fd0 2024-09-13T18:28:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.142+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7e810d8e0 con 0x7fe7e8101fd0 2024-09-13T18:28:35.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.143+0000 7fe7dea00640 1 -- 172.21.15.7:0/983036960 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7e810d8e0 con 0x7fe7e8101fd0 2024-09-13T18:28:35.145 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:28:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.144+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7cc0a1090 msgr2=0x7fe7cc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.144+0000 7fe7ed000640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7cc0a1090 0x7fe7cc0a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe7e81994d0 tx=0x7fe7d0005f90 comp rx=0 tx=0).stop 2024-09-13T18:28:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e8101fd0 msgr2=0x7fe7e8197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e8101fd0 0x7fe7e8197fc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8031500 tx=0x7fe7d8003c10 comp rx=0 tx=0).stop 2024-09-13T18:28:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 shutdown_connections 2024-09-13T18:28:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe7cc0a1090 0x7fe7cc0a3550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e8103b80 0x7fe7e819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7e81031c0 0x7fe7e8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 --2- 172.21.15.7:0/983036960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7e8101fd0 0x7fe7e8197fc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 >> 172.21.15.7:0/983036960 conn(0x7fe7e80fd730 msgr2=0x7fe7e81065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 shutdown_connections 2024-09-13T18:28:35.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.145+0000 7fe7ed000640 1 -- 172.21.15.7:0/983036960 wait complete. 2024-09-13T18:28:35.164 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:35.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.321+0000 7f91eaa00640 1 -- 172.21.15.7:0/139823180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fe060 msgr2=0x7f91e40fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 --2- 172.21.15.7:0/139823180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fe060 0x7f91e40fe460 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009900 tx=0x7f91d402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 -- 172.21.15.7:0/139823180 shutdown_connections 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 --2- 172.21.15.7:0/139823180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e40ff780 0x7f91e4100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 --2- 172.21.15.7:0/139823180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91e40fedc0 0x7f91e40ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 --2- 172.21.15.7:0/139823180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fe060 0x7f91e40fe460 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 -- 172.21.15.7:0/139823180 >> 172.21.15.7:0/139823180 conn(0x7f91e40f9b80 msgr2=0x7f91e40fbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 -- 172.21.15.7:0/139823180 shutdown_connections 2024-09-13T18:28:35.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.322+0000 7f91eaa00640 1 -- 172.21.15.7:0/139823180 wait complete. 2024-09-13T18:28:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 Processor -- start 2024-09-13T18:28:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 -- start start 2024-09-13T18:28:35.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e40fe060 0x7f91e4198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fedc0 0x7f91e4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91e40ff780 0x7f91e419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e419fb20 con 0x7f91e40fedc0 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e419fc90 con 0x7f91e40fe060 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91eaa00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e419fe50 con 0x7f91e40ff780 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fedc0 0x7f91e4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.323+0000 7f91dbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fedc0 0x7f91e4198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60826/0 (socket says 172.21.15.7:60826) 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91dbe00640 1 -- 172.21.15.7:0/1440850474 learned_addr learned my addr 172.21.15.7:0/1440850474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91e3e00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e40fe060 0x7f91e4198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91e8a00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91e40ff780 0x7f91e419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91dbe00640 1 -- 172.21.15.7:0/1440850474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91e40ff780 msgr2=0x7f91e419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91dbe00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91e40ff780 0x7f91e419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91dbe00640 1 -- 172.21.15.7:0/1440850474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e40fe060 msgr2=0x7f91e4198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91dbe00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e40fe060 0x7f91e4198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91dbe00640 1 -- 172.21.15.7:0/1440850474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4009560 con 0x7f91e40fedc0 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91dbe00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fedc0 0x7f91e4198570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00d950 tx=0x7f91cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91e1600640 1 -- 172.21.15.7:0/1440850474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc009c30 con 0x7f91e40fedc0 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.324+0000 7f91e1600640 1 -- 172.21.15.7:0/1440850474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91cc009d90 con 0x7f91e40fedc0 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.325+0000 7f91e1600640 1 -- 172.21.15.7:0/1440850474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc00f6b0 con 0x7f91e40fedc0 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.325+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e41a0130 con 0x7f91e40fedc0 2024-09-13T18:28:35.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.325+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e41a05f0 con 0x7f91e40fedc0 2024-09-13T18:28:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.326+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4109b70 con 0x7f91e40fedc0 2024-09-13T18:28:35.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.327+0000 7f91e1600640 1 -- 172.21.15.7:0/1440850474 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f91cc0109b0 con 0x7f91e40fedc0 2024-09-13T18:28:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.329+0000 7f91e1600640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f91c80a1090 0x7f91c80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.329+0000 7f91e1600640 1 -- 172.21.15.7:0/1440850474 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f91cc0cc650 con 0x7f91e40fedc0 2024-09-13T18:28:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.329+0000 7f91e3e00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f91c80a1090 0x7f91c80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.330+0000 7f91e3e00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f91c80a1090 0x7f91c80a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91d4031500 tx=0x7f91d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.333+0000 7f91e1600640 1 -- 172.21.15.7:0/1440850474 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f91cc095e40 con 0x7f91e40fedc0 2024-09-13T18:28:35.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.516+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91e41095e0 con 0x7f91e40fedc0 2024-09-13T18:28:35.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.517+0000 7f91e1600640 1 -- 172.21.15.7:0/1440850474 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91cc099460 con 0x7f91e40fedc0 2024-09-13T18:28:35.519 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T18:28:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.518+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f91c80a1090 msgr2=0x7f91c80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.518+0000 7f91eaa00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f91c80a1090 0x7f91c80a3550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91d4031500 tx=0x7f91d4005a20 comp rx=0 tx=0).stop 2024-09-13T18:28:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fedc0 msgr2=0x7f91e4198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fedc0 0x7f91e4198570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00d950 tx=0x7f91cc00de10 comp rx=0 tx=0).stop 2024-09-13T18:28:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 shutdown_connections 2024-09-13T18:28:35.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f91c80a1090 0x7f91c80a3550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91e40ff780 0x7f91e419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91e40fedc0 0x7f91e4198570 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 --2- 172.21.15.7:0/1440850474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e40fe060 0x7f91e4198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 >> 172.21.15.7:0/1440850474 conn(0x7f91e40f9b80 msgr2=0x7f91e40fb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 shutdown_connections 2024-09-13T18:28:35.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.519+0000 7f91eaa00640 1 -- 172.21.15.7:0/1440850474 wait complete. 2024-09-13T18:28:35.538 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:35.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 -- 172.21.15.7:0/420493944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334102fa0 msgr2=0x7fd334103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 --2- 172.21.15.7:0/420493944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334102fa0 0x7fd334103420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009900 tx=0x7fd31c02a410 comp rx=0 tx=0).stop 2024-09-13T18:28:35.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 -- 172.21.15.7:0/420493944 shutdown_connections 2024-09-13T18:28:35.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 --2- 172.21.15.7:0/420493944 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd334103960 0x7fd33410a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 --2- 172.21.15.7:0/420493944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334102fa0 0x7fd334103420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 --2- 172.21.15.7:0/420493944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd334101db0 0x7fd3341021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 -- 172.21.15.7:0/420493944 >> 172.21.15.7:0/420493944 conn(0x7fd3340fd530 msgr2=0x7fd3340ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.696+0000 7fd338e00640 1 -- 172.21.15.7:0/420493944 shutdown_connections 2024-09-13T18:28:35.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.697+0000 7fd338e00640 1 -- 172.21.15.7:0/420493944 wait complete. 2024-09-13T18:28:35.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.697+0000 7fd338e00640 1 Processor -- start 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.697+0000 7fd338e00640 1 -- start start 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd338e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd334101db0 0x7fd334197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd338e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd334102fa0 0x7fd334198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd338e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334103960 0x7fd33419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd338e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33419f8c0 con 0x7fd334103960 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd338e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33419fa30 con 0x7fd334102fa0 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd338e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33419fbf0 con 0x7fd334101db0 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334103960 0x7fd33419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd334101db0 0x7fd334197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334103960 0x7fd33419f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60846/0 (socket says 172.21.15.7:60846) 2024-09-13T18:28:35.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 -- 172.21.15.7:0/460229524 learned_addr learned my addr 172.21.15.7:0/460229524 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd32be00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd334102fa0 0x7fd334198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 -- 172.21.15.7:0/460229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd334101db0 msgr2=0x7fd334197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd334101db0 0x7fd334197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 -- 172.21.15.7:0/460229524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd334102fa0 msgr2=0x7fd334198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd334102fa0 0x7fd334198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333e00640 1 -- 172.21.15.7:0/460229524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c009560 con 0x7fd334103960 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.698+0000 7fd333400640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd334101db0 0x7fd334197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.699+0000 7fd333e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334103960 0x7fd33419f380 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00eaa0 tx=0x7fd32c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.699+0000 7fd330c00640 1 -- 172.21.15.7:0/460229524 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c00cdb0 con 0x7fd334103960 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.699+0000 7fd330c00640 1 -- 172.21.15.7:0/460229524 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd32c005020 con 0x7fd334103960 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.699+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33419fed0 con 0x7fd334103960 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.699+0000 7fd330c00640 1 -- 172.21.15.7:0/460229524 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0116d0 con 0x7fd334103960 2024-09-13T18:28:35.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.699+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3341a0300 con 0x7fd334103960 2024-09-13T18:28:35.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.700+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd334109230 con 0x7fd334103960 2024-09-13T18:28:35.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.702+0000 7fd330c00640 1 -- 172.21.15.7:0/460229524 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fd32c005190 con 0x7fd334103960 2024-09-13T18:28:35.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.703+0000 7fd330c00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd3180a1090 0x7fd3180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.704+0000 7fd330c00640 1 -- 172.21.15.7:0/460229524 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd32c0ccab0 con 0x7fd334103960 2024-09-13T18:28:35.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.704+0000 7fd333400640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd3180a1090 0x7fd3180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.704+0000 7fd333400640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd3180a1090 0x7fd3180a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd334102e00 tx=0x7fd324005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.707+0000 7fd330c00640 1 -- 172.21.15.7:0/460229524 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd32c0962a0 con 0x7fd334103960 2024-09-13T18:28:35.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:35 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/593252446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:28:35.712 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:35 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/983036960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:28:35.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:35 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/593252446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:28:35.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:35 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/983036960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:28:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:35 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/593252446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:28:35.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:35 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/983036960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:28:35.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.888+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd33402c410 con 0x7fd334103960 2024-09-13T18:28:35.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.888+0000 7fd330c00640 1 -- 172.21.15.7:0/460229524 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd32c01f020 con 0x7fd334103960 2024-09-13T18:28:35.891 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd3180a1090 msgr2=0x7fd3180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd3180a1090 0x7fd3180a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd334102e00 tx=0x7fd324005f90 comp rx=0 tx=0).stop 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334103960 msgr2=0x7fd33419f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334103960 0x7fd33419f380 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00eaa0 tx=0x7fd32c00ef60 comp rx=0 tx=0).stop 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 shutdown_connections 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fd3180a1090 0x7fd3180a3550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334103960 0x7fd33419f380 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd334102fa0 0x7fd334198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 --2- 172.21.15.7:0/460229524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd334101db0 0x7fd334197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.890+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 >> 172.21.15.7:0/460229524 conn(0x7fd3340fd530 msgr2=0x7fd334106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.891+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 shutdown_connections 2024-09-13T18:28:35.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:35.891+0000 7fd338e00640 1 -- 172.21.15.7:0/460229524 wait complete. 2024-09-13T18:28:35.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 -- 172.21.15.7:0/1060388858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 msgr2=0x7f7a9810a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/1060388858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9810a440 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009ca0 tx=0x7f7a9002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 -- 172.21.15.7:0/1060388858 shutdown_connections 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/1060388858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9810a440 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/1060388858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a981031f0 0x7f7a98103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/1060388858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a98102000 0x7f7a98102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 -- 172.21.15.7:0/1060388858 >> 172.21.15.7:0/1060388858 conn(0x7f7a980fd760 msgr2=0x7f7a980ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 -- 172.21.15.7:0/1060388858 shutdown_connections 2024-09-13T18:28:36.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.064+0000 7f7a9cc00640 1 -- 172.21.15.7:0/1060388858 wait complete. 2024-09-13T18:28:36.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.065+0000 7f7a9cc00640 1 Processor -- start 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.065+0000 7f7a9cc00640 1 -- start start 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.065+0000 7f7a9cc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a98102000 0x7f7a98197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.065+0000 7f7a9cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a981031f0 0x7f7a98198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.065+0000 7f7a9cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a9cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9819fad0 con 0x7f7a98103bb0 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a9cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9819fc40 con 0x7f7a981031f0 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a9cc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9819fe00 con 0x7f7a98102000 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a96800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a96800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9819f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60864/0 (socket says 172.21.15.7:60864) 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a95e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a98102000 0x7f7a98197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a96800640 1 -- 172.21.15.7:0/2983831461 learned_addr learned my addr 172.21.15.7:0/2983831461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a95400640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a981031f0 0x7f7a98198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a95e00640 1 -- 172.21.15.7:0/2983831461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a981031f0 msgr2=0x7f7a98198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a95e00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a981031f0 0x7f7a98198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a95e00640 1 -- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 msgr2=0x7f7a9819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a95e00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a95e00640 1 -- 172.21.15.7:0/2983831461 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a90009900 con 0x7f7a98102000 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.066+0000 7f7a96800640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.067+0000 7f7a95e00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a98102000 0x7f7a98197fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7a98103050 tx=0x7f7a8800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.067+0000 7f7a8ea00640 1 -- 172.21.15.7:0/2983831461 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88009c30 con 0x7f7a98102000 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.067+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a981a00e0 con 0x7f7a98102000 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.067+0000 7f7a8ea00640 1 -- 172.21.15.7:0/2983831461 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a88009d90 con 0x7f7a98102000 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.067+0000 7f7a8ea00640 1 -- 172.21.15.7:0/2983831461 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800f620 con 0x7f7a98102000 2024-09-13T18:28:36.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.067+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a981a0640 con 0x7f7a98102000 2024-09-13T18:28:36.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.068+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a98109460 con 0x7f7a98102000 2024-09-13T18:28:36.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.070+0000 7f7a8ea00640 1 -- 172.21.15.7:0/2983831461 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f7a88010460 con 0x7f7a98102000 2024-09-13T18:28:36.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.071+0000 7f7a8ea00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7a7c0a1090 0x7f7a7c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.071+0000 7f7a8ea00640 1 -- 172.21.15.7:0/2983831461 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7a880cca00 con 0x7f7a98102000 2024-09-13T18:28:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.072+0000 7f7a95400640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7a7c0a1090 0x7f7a7c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.072+0000 7f7a95400640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7a7c0a1090 0x7f7a7c0a3550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7a981994f0 tx=0x7f7a84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.074+0000 7f7a8ea00640 1 -- 172.21.15.7:0/2983831461 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a880961f0 con 0x7f7a98102000 2024-09-13T18:28:36.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.303+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f7a9810dac0 con 0x7f7a98102000 2024-09-13T18:28:36.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.312+0000 7f7a8ea00640 1 -- 172.21.15.7:0/2983831461 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+733402 (secure 0 0 0) 0x7f7a9810dac0 con 0x7f7a98102000 2024-09-13T18:28:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:28:36.329 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:28:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 20, 2024-09-13T18:28:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "active_gid": 14150, 2024-09-13T18:28:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "active_name": "x", 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addrs": { 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1436660417 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1436660417 2024-09-13T18:28:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addr": "172.21.15.7:6801/1436660417", 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "active_change": "2024-09-13T18:08:08.423357+0000", 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "active_mgr_features": 4540138322906710015, 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "available": true, 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "standbys": [ 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24109, 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540138322906710015, 2024-09-13T18:28:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-13T18:28:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-13T18:28:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-13T18:28:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-13T18:28:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap" 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-13T18:28:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-13T18:28:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-13T18:28:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:28:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:28:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-13T18:28:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-13T18:28:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:28:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-13T18:28:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-13T18:28:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-13T18:28:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-13T18:28:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:28:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-13T18:28:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-13T18:28:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-13T18:28:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-13T18:28:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:28:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:28:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:28:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:28:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:28:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:28:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:28:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-13T18:28:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:28:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-13T18:28:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-13T18:28:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-13T18:28:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-13T18:28:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:28:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.603 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.604 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-13T18:28:36.605 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.606 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.607 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.610 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.616 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.618 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.620 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.621 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.624 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:28:36.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:28:36.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.629 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.630 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.633 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:36.635 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.636 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.637 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.642 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.643 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.644 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-13T18:28:36.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.647 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.649 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-13T18:28:36.650 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-13T18:28:36.651 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.653 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.654 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.655 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.657 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.659 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-13T18:28:36.661 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-13T18:28:36.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.663 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.664 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.665 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.667 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.672 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.673 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.676 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.678 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.680 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-13T18:28:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.698 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:36.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.702 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.704 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.705 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.706 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.707 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.709 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.710 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-13T18:28:36.711 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.714 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.715 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.718 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-13T18:28:36.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.724 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.726 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.730 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.730 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.732 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-13T18:28:36.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.734 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.737 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.739 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.748 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.750 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.751 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-13T18:28:36.752 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.753 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.755 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.757 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.758 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.759 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.760 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.761 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.765 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.766 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.769 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-13T18:28:36.770 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.771 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.775 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.777 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.778 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24113, 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "y", 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540138322906710015, 2024-09-13T18:28:36.783 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.786 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.790 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.795 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.796 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.797 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-13T18:28:36.799 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-13T18:28:36.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-13T18:28:36.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-13T18:28:36.802 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-13T18:28:36.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-13T18:28:36.804 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-13T18:28:36.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.808 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.811 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-13T18:28:36.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-13T18:28:36.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap" 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-13T18:28:36.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:36.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.819 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:28:36.821 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.822 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-13T18:28:36.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-13T18:28:36.828 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.833 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.834 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:28:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:28:36.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-13T18:28:36.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-13T18:28:36.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-13T18:28:36.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.858 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.860 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:28:36.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.863 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-13T18:28:36.868 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-13T18:28:36.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:28:36.870 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-13T18:28:36.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-13T18:28:36.884 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.887 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-13T18:28:36.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.892 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.893 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:28:36.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:28:36.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:28:36.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:28:36.898 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:28:36.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:28:36.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:28:36.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:28:36.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:28:36.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:28:36.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:28:36.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:28:36.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.923 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.926 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:28:36.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:28:36.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-13T18:28:36.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-13T18:28:36.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.941 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.949 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.951 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.954 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-13T18:28:36.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.965 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.967 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-13T18:28:36.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-13T18:28:36.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-13T18:28:36.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.972 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-13T18:28:36.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.975 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.976 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.978 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.983 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:28:36.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:36.991 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.995 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:36.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:36.999 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.000 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.003 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.006 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.008 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.012 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.013 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.016 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.023 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.025 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:28:37.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.028 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.031 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.032 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.035 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-13T18:28:37.037 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.038 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.044 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.046 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.049 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.051 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.052 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.053 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.057 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.058 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.059 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.060 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.061 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.063 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.064 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.065 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.068 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.069 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.070 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.074 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.075 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.077 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.078 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.079 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.080 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.082 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.083 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.084 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.085 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.086 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.088 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.089 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.090 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.091 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.094 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.095 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.096 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.099 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-13T18:28:37.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-13T18:28:37.102 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.103 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.105 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.107 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.108 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.111 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.116 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.118 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.120 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.121 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.122 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.123 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.124 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.127 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.134 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.136 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.137 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.140 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-13T18:28:37.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.149 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.150 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.153 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.154 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.159 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.161 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.164 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.167 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.168 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-13T18:28:37.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.172 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.173 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.174 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.175 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.176 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:28:37.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:28:37.178 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.180 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.185 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.186 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.187 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.189 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.190 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.191 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.192 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.193 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.194 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.195 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.196 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.197 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.198 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.199 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-13T18:28:37.211 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.213 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-13T18:28:37.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.215 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.216 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.217 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.218 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.219 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.221 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.222 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.223 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.224 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:28:37.225 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "modules": [ 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-13T18:28:37.226 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard", 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "iostat", 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "nfs", 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "restful" 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.227 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.228 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.229 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.230 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.232 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.233 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.234 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-13T18:28:37.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-13T18:28:37.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-13T18:28:37.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-13T18:28:37.239 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-13T18:28:37.240 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.241 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.243 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.244 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-13T18:28:37.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:28:37.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-13T18:28:37.247 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.250 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap" 2024-09-13T18:28:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:28:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:28:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-13T18:28:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-13T18:28:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-13T18:28:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:28:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:28:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-13T18:28:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:28:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:28:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-13T18:28:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-13T18:28:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:28:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:28:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-13T18:28:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:28:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:28:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:28:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:28:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-13T18:28:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:28:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-13T18:28:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-13T18:28:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-13T18:28:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-13T18:28:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:28:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-13T18:28:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-13T18:28:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:28:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-13T18:28:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-13T18:28:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-13T18:28:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-13T18:28:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:28:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-13T18:28:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-13T18:28:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-13T18:28:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-13T18:28:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-13T18:28:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-13T18:28:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-13T18:28:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-13T18:28:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-13T18:28:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.654 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.655 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.658 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.660 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:28:37.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:28:37.662 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:28:37.663 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-13T18:28:37.664 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.665 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-13T18:28:37.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-13T18:28:37.670 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-13T18:28:37.671 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:28:37.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "services": { 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard": "https://172.21.15.7:8443/" 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "always_on_modules": { 2024-09-13T18:28:37.675 INFO:teuthology.orchestra.run.smithi007.stdout: "octopus": [ 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "pacific": [ 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-13T18:28:37.676 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "quincy": [ 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-13T18:28:37.677 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "reef": [ 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-13T18:28:37.678 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "last_failure_osd_epoch": 3, 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "active_clients": [ 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-13T18:28:37.679 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3413020614 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "libcephsqlite", 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-13T18:28:37.680 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1869741794 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-13T18:28:37.681 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3049309851 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4207444935 2024-09-13T18:28:37.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.683 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:37.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:37.683 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-13T18:28:37.683 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:28:37.684 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:36 smithi067 ceph-mon[35103]: pgmap v691: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:28:37.684 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:36 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1440850474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:28:37.684 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:36 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/460229524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:28:37.684 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:36 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/2983831461' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T18:28:37.684 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:36 smithi116 ceph-mon[35109]: pgmap v691: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:28:37.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:36 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1440850474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:28:37.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:36 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/460229524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:28:37.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:36 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/2983831461' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7a7c0a1090 msgr2=0x7f7a7c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7a7c0a1090 0x7f7a7c0a3550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7a981994f0 tx=0x7f7a84005f90 comp rx=0 tx=0).stop 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a98102000 msgr2=0x7f7a98197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a98102000 0x7f7a98197fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7a98103050 tx=0x7f7a8800dde0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 shutdown_connections 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f7a7c0a1090 0x7f7a7c0a3550 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a98103bb0 0x7f7a9819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a981031f0 0x7f7a98198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 --2- 172.21.15.7:0/2983831461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a98102000 0x7f7a98197fe0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 >> 172.21.15.7:0/2983831461 conn(0x7f7a980fd760 msgr2=0x7f7a98106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 shutdown_connections 2024-09-13T18:28:37.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:28:36.320+0000 7f7a9cc00640 1 -- 172.21.15.7:0/2983831461 wait complete. 2024-09-13T18:28:37.692 DEBUG:tasks.check_counter:Getting stats from a 2024-09-13T18:28:37.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-13T18:28:37.693 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:36 smithi007 ceph-mon[30588]: pgmap v691: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-13T18:28:37.693 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:36 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1440850474' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:28:37.693 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:36 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/460229524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:28:37.693 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:36 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/2983831461' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T18:28:38.024 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:28:38.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:38 smithi116 ceph-mon[35109]: pgmap v692: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:38.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:38 smithi067 ceph-mon[35103]: pgmap v692: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:38.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:38 smithi007 ceph-mon[30588]: pgmap v692: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 808, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 810, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 271433, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 251289, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.133660071, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.063637374, 2024-09-13T18:28:40.107 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.026210342, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.027075819, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 808, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.065194998, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000080686 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.108 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1499, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 1664, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 385036, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 836451, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 4, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.162783009, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.059687517, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.041573210, 2024-09-13T18:28:40.109 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.048876984, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1663, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.086506599, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000052018 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 371760 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.110 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 237, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 231, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 768804, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 127968, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.048401241, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.024248977, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.029142137, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000055667, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 230, 2024-09-13T18:28:40.111 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.020370931, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000088569 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 767456, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 127024 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-09-13T18:28:40.112 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3904, 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.114070488, 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000029218 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-13T18:28:40.113 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-09-13T18:28:40.114 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-09-13T18:28:40.115 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 1, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-09-13T18:28:40.116 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:28:40.117 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.118 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:28:40.119 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-09-13T18:28:40.120 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 4, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 1, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 4194304, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 4195688, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 4195547, 2024-09-13T18:28:40.121 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 4 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 3, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 3, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 0, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 1, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 1, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 0, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 0, 2024-09-13T18:28:40.122 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 46440, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 207124 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-09-13T18:28:40.123 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.124 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.125 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-09-13T18:28:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-09-13T18:28:40.127 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.128 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.128 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-09-13T18:28:40.128 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.130 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-09-13T18:28:40.131 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.132 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.133 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-09-13T18:28:40.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-09-13T18:28:40.135 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 2, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 1, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 2, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 2854, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-13T18:28:40.136 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-13T18:28:40.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-13T18:28:40.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 197463, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 54, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-13T18:28:40.139 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 7496, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 154, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 8368, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 13, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-13T18:28:40.140 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 2305, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 21, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 3, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 2305, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2305, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 1.121982765, 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000486760 2024-09-13T18:28:40.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2305, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 2306 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 2305, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 2305, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 1490, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 813, 2024-09-13T18:28:40.142 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 1, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-09-13T18:28:40.143 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-09-13T18:28:40.144 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 88, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-09-13T18:28:40.145 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 2, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 6, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 6, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 0, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-09-13T18:28:40.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "osd-slow-ops": { 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:28:40.147 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 2540, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1181678, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 2540, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2540, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1181678, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.148 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 2305, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 1389, 2024-09-13T18:28:40.149 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2305, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1389, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:40.150 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 2305, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 2305, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2305, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 2305, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-13T18:28:40.151 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x558f95dee500": { 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-13T18:28:40.153 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:40.154 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:40.154 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:40.154 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:40.154 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.154 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:40.154 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:28:40.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:40 smithi116 ceph-mon[35109]: pgmap v693: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-13T18:28:40.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:40 smithi067 ceph-mon[35103]: pgmap v693: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-13T18:28:40.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:40 smithi007 ceph-mon[30588]: pgmap v693: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-13T18:28:41.231 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-13T18:28:41.232 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-13T18:28:41.232 DEBUG:tasks.check_counter:Getting stats from d 2024-09-13T18:28:41.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-13T18:28:41.568 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:28:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:42 smithi116 ceph-mon[35109]: pgmap v694: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-09-13T18:28:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:42.711 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:42 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:42.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:42 smithi007 ceph-mon[30588]: pgmap v694: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-09-13T18:28:42.733 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:42.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:42.734 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:42 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:42 smithi067 ceph-mon[35103]: pgmap v694: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-09-13T18:28:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:42.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:42 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:43.476 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:28:43.476 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 2992, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.006198500, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000081139, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.003479653, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:43.477 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.006005120, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.002001706 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:28:43.478 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 231, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 226, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 747056, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 128800, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.051415616, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.026646058, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.030658090, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 225, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.018477316, 2024-09-13T18:28:43.479 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000082121 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 747056, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 128800 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 172, 2024-09-13T18:28:43.480 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 106400, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.022294634, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.017748004, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001310371, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 170, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.013533450, 2024-09-13T18:28:43.481 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000079608 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 106400 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.482 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:28:43.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:28:43.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 149998, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-13T18:28:43.485 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-09-13T18:28:43.486 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 232, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 714428, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:43.487 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 232, 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 232, 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 714428, 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:43.488 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:28:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:43.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:43 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:43.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:43 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:43.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:43.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:43.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:43 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' 2024-09-13T18:28:44.194 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-13T18:28:44.194 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-13T18:28:44.194 DEBUG:tasks.check_counter:Getting stats from g 2024-09-13T18:28:44.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-13T18:28:44.517 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:28:44.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:44 smithi067 ceph-mon[35103]: pgmap v695: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-09-13T18:28:44.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:44 smithi007 ceph-mon[30588]: pgmap v695: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-09-13T18:28:44.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:44 smithi116 ceph-mon[35109]: pgmap v695: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 KiB/s wr, 12 op/s 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 2992, 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-13T18:28:46.444 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.008503979, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000082358, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.003471615, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.006104368, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.002034789 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:46.445 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 228, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 223, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 746240, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 127024, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.049552518, 2024-09-13T18:28:46.446 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.025620282, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.029301969, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 222, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.018323418, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000082537 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.447 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 746240, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 127024 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 169, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 105872, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.021680401, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.017038819, 2024-09-13T18:28:46.448 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001388163, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 167, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.012689603, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000075985 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.449 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 105872 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:28:46.450 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:28:46.451 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-13T18:28:46.452 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 149998, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 30, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-13T18:28:46.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:28:46.454 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 229, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 714038, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 229, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 229, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 714038, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:46.455 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:46.456 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:46.456 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:46.456 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:46.456 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:28:46.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:46 smithi067 ceph-mon[35103]: pgmap v696: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 13 op/s 2024-09-13T18:28:46.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:46 smithi007 ceph-mon[30588]: pgmap v696: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 13 op/s 2024-09-13T18:28:46.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:46 smithi116 ceph-mon[35109]: pgmap v696: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 13 op/s 2024-09-13T18:28:47.186 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-13T18:28:47.186 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-13T18:28:47.186 DEBUG:tasks.check_counter:Getting stats from j 2024-09-13T18:28:47.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-13T18:28:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:28:48.621 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:48 smithi007 ceph-mon[30588]: pgmap v697: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-09-13T18:28:48.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:48 smithi067 ceph-mon[35103]: pgmap v697: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-09-13T18:28:48.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:48 smithi116 ceph-mon[35109]: pgmap v697: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 2366, 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2368, 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 670228, 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 735833, 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-13T18:28:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.235082537, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.077726609, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.062563037, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.073221155, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2366, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.103649722, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000043807 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 7, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 178, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3708, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 376668, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-13T18:28:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.021778373, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.014584317, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.004772233, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000106974, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 177, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.018433475, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000104143 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 375984 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 243, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 237, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 769900, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 132071, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-13T18:28:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.044799894, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018583122, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.034708428, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000019916, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 236, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.020114604, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000085231 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 769632, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 131760 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3991, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.099507719, 2024-09-13T18:28:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000024933 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-09-13T18:28:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 0, 2024-09-13T18:28:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 1, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:28:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:28:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-09-13T18:28:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-09-13T18:28:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-09-13T18:28:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 3, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-09-13T18:28:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 1, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 4194304, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 4195377, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 4195236, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 3 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 3, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 3, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 0, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 1, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 1, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 0, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 0, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 0, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 0, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-09-13T18:28:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 46464, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 207124 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-09-13T18:28:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-09-13T18:28:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-09-13T18:28:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:28:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 0, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 1, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 1, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 1, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-09-13T18:28:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 1046, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:28:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:28:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:28:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 182351, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 48, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 7496, 2024-09-13T18:28:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 154, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 8368, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 13, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-09-13T18:28:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 2369, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 21, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 3, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 2369, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2369, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 1.258980633, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000531439 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-09-13T18:28:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2369, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 2370 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 2369, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 2369, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 1546, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 821, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-09-13T18:28:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 1, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-09-13T18:28:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-09-13T18:28:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 88, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-09-13T18:28:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 2, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 4, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 4, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 0, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-09-13T18:28:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "osd-slow-ops": { 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-09-13T18:28:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 2612, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 1193345, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 2612, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2612, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1193345, 2024-09-13T18:28:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 2369, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 1078, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2369, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1078, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 2369, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 2369, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2369, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 2369, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x55a59be8a5a0": { 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-13T18:28:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T18:28:49.377 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T18:28:50.130 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-09-13T18:28:50.130 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-09-13T18:28:50.130 DEBUG:tasks.check_counter:Getting stats from b 2024-09-13T18:28:50.130 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-13T18:28:50.343 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:28:50.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:50 smithi067 ceph-mon[35103]: pgmap v698: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-13T18:28:50.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:50 smithi007 ceph-mon[30588]: pgmap v698: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-13T18:28:50.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:50 smithi116 ceph-mon[35109]: pgmap v698: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-13T18:28:52.230 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-13T18:28:52.230 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:28:52.230 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 5741, 2024-09-13T18:28:52.230 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 7328, 2024-09-13T18:28:52.230 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1762368, 2024-09-13T18:28:52.230 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 10084986, 2024-09-13T18:28:52.230 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 16, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 5, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.621271255, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.245460652, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.261824232, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.119069036, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 7328, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.939357940, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000128187 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:52.231 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 5499, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.001334013, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000242 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 905120, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 1499280 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 706, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 697, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 164800, 2024-09-13T18:28:52.232 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 522829, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 10, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 7, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.069597603, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.029172751, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.040722935, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.005296620, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 695, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.165633227, 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000238321 2024-09-13T18:28:52.233 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 728, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000233297, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000320 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 380640 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 1409, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 975, 2024-09-13T18:28:52.234 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1151896, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 298414, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 9, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 7, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.145236979, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.051400379, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.114981501, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.007228592, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 973, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.233701422, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000240186 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.235 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1576, 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000335670, 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000212 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 835632, 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 135872 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-13T18:28:52.236 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 5008, 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.279644839, 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000255520 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 16, 2024-09-13T18:28:52.237 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000439367, 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000027460 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 645, 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 645, 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 645, 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2.941699466, 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004560774 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.238 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 12, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 24, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 24, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 24, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-13T18:28:52.239 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 2, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 2, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 659, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 653, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 0, 2024-09-13T18:28:52.240 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 4, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 234, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:28:52.241 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 611, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 612, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 599, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 720, 2024-09-13T18:28:52.242 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 703, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 1, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 621 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 7, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 1, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2024-09-13T18:28:52.243 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 3, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 2, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-13T18:28:52.244 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 2226, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 2226, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-13T18:28:52.245 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 3, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 3, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 11669635, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2210, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 4.270846820, 2024-09-13T18:28:52.246 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001932509 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 24, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 26, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 2, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 19, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 20, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 1, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 24, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 28, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 4, 2024-09-13T18:28:52.247 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 2, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 17, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 15, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 52696, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 207124 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 1862, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 1, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 645, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 20, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 2, 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-13T18:28:52.248 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 5, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.003574080, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000714816 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 16, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.003923596, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000245224 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.249 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.250 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000104568, 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000104568 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.251 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.252 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.253 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.253 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.253 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-13T18:28:52.253 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8, 2024-09-13T18:28:52.253 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.012687481, 2024-09-13T18:28:52.253 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001585935 2024-09-13T18:28:52.253 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.254 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.004147082, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.002073541 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.001854133, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000927066 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.255 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.007133074, 2024-09-13T18:28:52.256 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.003566537 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 600, 2024-09-13T18:28:52.257 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2.883904096, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.004806506 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-13T18:28:52.258 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 8, 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.022805104, 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.002850638 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.259 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.001566252, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001566252 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.260 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 3, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 2, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 89, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 89, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 696, 2024-09-13T18:28:52.261 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:28:52.262 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:28:52.263 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:28:52.264 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 291756, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 118, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 7496, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 154, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:28:52.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 96738, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 691, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-13T18:28:52.266 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 3419, 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 7493617, 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 37, 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 3419, 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-13T18:28:52.267 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3419, 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 23.049493771, 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.006741589 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3419, 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3455 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.268 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 3419, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 1, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 3418, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 11, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 1, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 2211, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 55, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 0, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-13T18:28:52.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 515, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 22, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-13T18:28:52.270 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 599, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-13T18:28:52.271 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 88, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 3, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 12, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 12, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-13T18:28:52.272 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 36, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 5 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.273 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 2, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 2, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 2, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 2, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:28:52.274 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 7852, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 2252009, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 7852, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 7852, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 2252009, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.275 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 3419, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 7493819, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 3419, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 7493819, 2024-09-13T18:28:52.276 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:52.277 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 3419, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 3419, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 3419, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 3419, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:52.278 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 2, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 202, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 2, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 1, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 202, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.279 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x5561150b20a0": { 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 2226, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 7475331, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 2226, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:52.280 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 2210, 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 7475331, 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:52.281 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-13T18:28:52.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:52 smithi067 ceph-mon[35103]: pgmap v699: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-13T18:28:52.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:52 smithi007 ceph-mon[30588]: pgmap v699: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-13T18:28:52.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:52 smithi116 ceph-mon[35109]: pgmap v699: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-13T18:28:53.053 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-13T18:28:53.053 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-13T18:28:53.053 DEBUG:tasks.check_counter:Getting stats from e 2024-09-13T18:28:53.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-13T18:28:53.260 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:28:54.647 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:54 smithi067 ceph-mon[35103]: pgmap v700: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-13T18:28:54.763 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:54 smithi116 ceph-mon[35109]: pgmap v700: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-13T18:28:54.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:54 smithi007 ceph-mon[30588]: pgmap v700: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-13T18:28:54.981 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-13T18:28:54.981 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:28:54.981 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 1716, 2024-09-13T18:28:54.981 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 1718, 2024-09-13T18:28:54.982 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 4699655, 2024-09-13T18:28:54.982 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 533686, 2024-09-13T18:28:54.982 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 6, 2024-09-13T18:28:54.982 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-13T18:28:54.982 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.158043619, 2024-09-13T18:28:54.982 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.061495672, 2024-09-13T18:28:54.983 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.040111161, 2024-09-13T18:28:54.983 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.042047648, 2024-09-13T18:28:54.983 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:54.983 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1716, 2024-09-13T18:28:54.983 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.063382715, 2024-09-13T18:28:54.984 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000036936 2024-09-13T18:28:54.984 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.984 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:54.984 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:54.984 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:54.984 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:54.985 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.985 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:28:54.985 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:28:54.985 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.985 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:28:54.985 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 286, 2024-09-13T18:28:54.986 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 457, 2024-09-13T18:28:54.986 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 72950, 2024-09-13T18:28:54.986 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 465025, 2024-09-13T18:28:54.986 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 5, 2024-09-13T18:28:54.986 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-13T18:28:54.987 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.036523980, 2024-09-13T18:28:54.987 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.013706746, 2024-09-13T18:28:54.987 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.009361967, 2024-09-13T18:28:54.987 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.009860368, 2024-09-13T18:28:54.987 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:54.988 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 456, 2024-09-13T18:28:54.988 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.024245560, 2024-09-13T18:28:54.988 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000053170 2024-09-13T18:28:54.988 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.988 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:54.989 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:54.989 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:54.989 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:54.989 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.989 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-13T18:28:54.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 377568 2024-09-13T18:28:54.990 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.990 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:28:54.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 1326, 2024-09-13T18:28:54.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 1320, 2024-09-13T18:28:54.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 4321890, 2024-09-13T18:28:54.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 468453, 2024-09-13T18:28:54.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 3, 2024-09-13T18:28:54.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-13T18:28:54.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.129976649, 2024-09-13T18:28:54.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.042572063, 2024-09-13T18:28:54.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.053793764, 2024-09-13T18:28:54.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.032046616, 2024-09-13T18:28:54.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:54.992 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1319, 2024-09-13T18:28:54.992 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.042730439, 2024-09-13T18:28:54.992 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000032396 2024-09-13T18:28:54.992 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:54.993 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:54.993 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:54.993 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:54.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 769520, 2024-09-13T18:28:54.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 131328 2024-09-13T18:28:54.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.994 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-13T18:28:54.994 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-13T18:28:54.994 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-13T18:28:54.994 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.994 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-13T18:28:54.994 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:28:54.995 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:28:54.995 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 5265, 2024-09-13T18:28:54.995 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.120021505, 2024-09-13T18:28:54.995 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000022796 2024-09-13T18:28:54.995 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:54.996 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.996 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-13T18:28:54.996 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:28:54.996 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:28:54.996 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:54.996 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:54.997 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:54.997 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:54.997 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.997 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-13T18:28:54.997 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 0, 2024-09-13T18:28:54.997 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 0, 2024-09-13T18:28:54.997 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-13T18:28:54.998 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:54.998 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:54.998 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:54.998 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:54.998 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-13T18:28:54.998 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-13T18:28:54.998 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-13T18:28:54.999 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-13T18:28:54.999 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 0, 2024-09-13T18:28:54.999 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-13T18:28:54.999 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-13T18:28:54.999 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 18, 2024-09-13T18:28:54.999 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-13T18:28:54.999 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 18, 2024-09-13T18:28:55.000 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-13T18:28:55.000 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 18, 2024-09-13T18:28:55.000 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-13T18:28:55.000 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 0, 2024-09-13T18:28:55.000 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 0, 2024-09-13T18:28:55.000 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-13T18:28:55.001 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 0, 2024-09-13T18:28:55.001 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 0, 2024-09-13T18:28:55.001 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-13T18:28:55.001 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-13T18:28:55.001 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:28:55.001 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-13T18:28:55.001 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 0, 2024-09-13T18:28:55.002 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-13T18:28:55.002 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-13T18:28:55.002 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-13T18:28:55.002 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-13T18:28:55.002 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-13T18:28:55.002 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-13T18:28:55.003 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-13T18:28:55.003 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:28:55.003 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-13T18:28:55.003 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 4, 2024-09-13T18:28:55.003 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 234, 2024-09-13T18:28:55.003 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-13T18:28:55.004 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:28:55.004 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-13T18:28:55.004 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:28:55.004 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:28:55.004 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:28:55.004 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:28:55.005 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:28:55.005 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 0, 2024-09-13T18:28:55.005 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:28:55.005 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:28:55.005 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:28:55.005 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:28:55.006 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:28:55.006 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:28:55.006 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 0, 2024-09-13T18:28:55.006 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:28:55.006 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 0, 2024-09-13T18:28:55.007 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 0 2024-09-13T18:28:55.007 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.007 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-13T18:28:55.007 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-13T18:28:55.007 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-13T18:28:55.008 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-13T18:28:55.008 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-13T18:28:55.008 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-13T18:28:55.008 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 0, 2024-09-13T18:28:55.008 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2024-09-13T18:28:55.008 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:28:55.009 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 0, 2024-09-13T18:28:55.009 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 0, 2024-09-13T18:28:55.009 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 0, 2024-09-13T18:28:55.009 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-13T18:28:55.009 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-13T18:28:55.010 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:28:55.010 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:28:55.010 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-13T18:28:55.010 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-13T18:28:55.010 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:28:55.010 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-13T18:28:55.010 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-13T18:28:55.011 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:28:55.011 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-13T18:28:55.011 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-13T18:28:55.011 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.011 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-13T18:28:55.011 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 0, 2024-09-13T18:28:55.012 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-13T18:28:55.012 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-13T18:28:55.012 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 2226, 2024-09-13T18:28:55.012 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-13T18:28:55.012 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-13T18:28:55.012 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 0, 2024-09-13T18:28:55.013 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-13T18:28:55.013 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-13T18:28:55.013 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 3, 2024-09-13T18:28:55.013 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-13T18:28:55.013 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-13T18:28:55.014 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-13T18:28:55.014 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 11669635, 2024-09-13T18:28:55.014 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 11666213, 2024-09-13T18:28:55.014 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-13T18:28:55.014 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.014 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.015 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.015 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.015 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 2226 2024-09-13T18:28:55.015 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.015 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-13T18:28:55.015 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 15, 2024-09-13T18:28:55.016 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 17, 2024-09-13T18:28:55.016 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 2, 2024-09-13T18:28:55.016 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 10, 2024-09-13T18:28:55.016 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 11, 2024-09-13T18:28:55.016 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 1, 2024-09-13T18:28:55.017 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 18, 2024-09-13T18:28:55.017 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 19, 2024-09-13T18:28:55.017 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 1, 2024-09-13T18:28:55.017 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 0, 2024-09-13T18:28:55.017 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 0, 2024-09-13T18:28:55.017 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 0, 2024-09-13T18:28:55.017 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 51140, 2024-09-13T18:28:55.018 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 207124 2024-09-13T18:28:55.018 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.018 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-13T18:28:55.018 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 0, 2024-09-13T18:28:55.018 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-13T18:28:55.018 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 0, 2024-09-13T18:28:55.019 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 0, 2024-09-13T18:28:55.019 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2024-09-13T18:28:55.019 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-13T18:28:55.019 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.019 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.019 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.020 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-13T18:28:55.020 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.020 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.020 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.020 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.021 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-13T18:28:55.021 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.021 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.021 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.021 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.022 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-13T18:28:55.022 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.022 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.022 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.022 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.022 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-13T18:28:55.022 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.023 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.023 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.023 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-13T18:28:55.023 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.023 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.024 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.026 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.027 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.028 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-13T18:28:55.028 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.028 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.028 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.029 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.030 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-13T18:28:55.031 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-13T18:28:55.032 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.033 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.034 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:28:55.035 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 1, 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 3, 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 2, 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 2, 2024-09-13T18:28:55.036 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 0, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 0, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 3303, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:28:55.037 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:28:55.038 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-13T18:28:55.039 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 189460, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 52, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-13T18:28:55.040 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 7496, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 154, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 58578, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 354, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-13T18:28:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 3081, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 26, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 4, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 3081, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3081, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.233973119, 2024-09-13T18:28:55.042 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000400510 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3081, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 3082 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 3081, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 3081, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 0, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 1633, 2024-09-13T18:28:55.043 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 1445, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-13T18:28:55.044 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 2, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2024-09-13T18:28:55.045 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-13T18:28:55.046 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-13T18:28:55.046 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-13T18:28:55.046 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-13T18:28:55.046 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-13T18:28:55.046 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-13T18:28:55.046 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-13T18:28:55.046 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 88, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 2, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 5, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 5, 2024-09-13T18:28:55.047 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 0, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 2, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 0 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 0, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.048 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 0, 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 0, 2024-09-13T18:28:55.049 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 0, 2024-09-13T18:28:55.050 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-13T18:28:55.050 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.050 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:28:55.050 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:55.050 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:28:55.050 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 3324, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 8779930, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 3324, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 3324, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 8779930, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.051 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 3081, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 7475341, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 3081, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 7475341, 2024-09-13T18:28:55.052 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:55.053 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 3081, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 3081, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 3081, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 3081, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:28:55.054 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.055 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x55ac2576e5a0": { 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:55.056 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 0, 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 0, 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:55.057 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-13T18:28:55.803 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-13T18:28:55.804 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-13T18:28:55.804 DEBUG:tasks.check_counter:Getting stats from h 2024-09-13T18:28:55.804 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-13T18:28:56.007 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:28:56.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:56 smithi067 ceph-mon[35103]: pgmap v701: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-13T18:28:56.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:56 smithi007 ceph-mon[30588]: pgmap v701: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-13T18:28:56.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:56 smithi116 ceph-mon[35109]: pgmap v701: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-13T18:28:57.511 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 35, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 37, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 8965, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 53715, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 13, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.007439798, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000811936, 2024-09-13T18:28:57.512 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.004582765, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000671439, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 35, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.016800460, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000480013 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 19, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000003155, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000166 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.513 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 2176, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 3328 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 13, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 185, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 3451, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 382531, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 6, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.010995795, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.007130040, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.001861412, 2024-09-13T18:28:57.514 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000304491, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 183, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.019527254, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000106706 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 376944 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.515 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 755, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 794, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 893594, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 245558, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 5, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.106276942, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.048555876, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.061036293, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.004666661, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 794, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.051268971, 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000064570 2024-09-13T18:28:57.516 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 992, 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000264475, 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000266 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 785488, 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 135616 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-13T18:28:57.517 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 54, 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.001613310, 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000029876 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:28:57.518 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000012139, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000006069 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 4, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 3, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.002828309, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000942769 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-13T18:28:57.519 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 1, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 11, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 12, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 12, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 11, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 0, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 2, 2024-09-13T18:28:57.520 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 8, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 6, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 2, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:28:57.521 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 5, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 298, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:28:57.522 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 0 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 3, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-13T18:28:57.523 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-13T18:28:57.524 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 3, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 3, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 1, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-13T18:28:57.525 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 1, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 4195377, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 0, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.005667059, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001889019 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 0 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.526 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 15, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 15, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 0, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 13, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 14, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 1, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 12, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 12, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 0, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 0, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 3, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 3, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 48136, 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 198932 2024-09-13T18:28:57.527 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 9, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 4, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 4, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 1, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.001618645, 2024-09-13T18:28:57.528 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001618645 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.529 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.001209664, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000604832 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.530 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.531 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.532 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.533 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-13T18:28:57.534 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.535 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.536 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.537 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.538 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.539 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 0, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 1, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 1, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 0, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 2, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 2, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 78, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.540 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:28:57.541 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-13T18:28:57.542 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 238919, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 80, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 88, 2024-09-13T18:28:57.543 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 1, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 7496, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 154, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-13T18:28:57.544 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 58640, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 237, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 41, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 11600, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 28, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 41, 2024-09-13T18:28:57.545 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 41, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.219995211, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.005365736 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 41, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 65 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 41, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 0, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 41, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-13T18:28:57.546 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 10, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 3, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 7, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 6, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-13T18:28:57.547 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 20, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:28:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-13T18:28:57.549 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 88, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 2, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 8, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 8, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 17, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 0, 2024-09-13T18:28:57.550 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 2 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 1, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:28:57.551 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 0, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 0, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 0, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 799, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 817119, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 799, 2024-09-13T18:28:57.552 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 799, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 817119, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:28:57.553 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 41, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 11600, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 41, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 11600, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.554 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 41, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 41, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 41, 2024-09-13T18:28:57.555 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 41, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:28:57.556 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x556b15e8e0a0": { 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:28:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 3, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 1073, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 3, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 3, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 1073, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:28:57.558 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:28:57.559 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.559 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:28:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-13T18:28:58.217 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-13T18:28:58.217 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-13T18:28:58.218 DEBUG:tasks.check_counter:Getting stats from k 2024-09-13T18:28:58.218 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-13T18:28:58.416 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:28:58.747 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:28:58 smithi067 ceph-mon[35103]: pgmap v702: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:28:58.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:28:58 smithi007 ceph-mon[30588]: pgmap v702: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:28:58.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:28:58 smithi116 ceph-mon[35109]: pgmap v702: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-13T18:29:00.052 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 1072, 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 1066, 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 1048320, 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 390733, 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 5, 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.130515465, 2024-09-13T18:29:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.055154560, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.048184695, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.023829958, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 1065, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.060978165, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000057256 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 770448, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 133536 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 707, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 883, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 174488, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 598866, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 5, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 4, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.072028248, 2024-09-13T18:29:00.055 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.023728172, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.016353646, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.025238087, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 881, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.027987273, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000031767 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.056 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 379232 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 836, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 836, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 222026, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 259201, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 3, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.070476336, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.021514266, 2024-09-13T18:29:00.057 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.021729090, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.020929521, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 835, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.030311360, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000036301 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-13T18:29:00.058 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 1, 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-MDSRank": { 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3814, 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.100912558, 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000026458 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "finisher-PurgeQueue": { 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "queue_len": 0, 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "complete_latency": { 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "request": 0, 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "reply": 0, 2024-09-13T18:29:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: "reply_latency": { 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_reply": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "forward": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_complete": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_fetch_keys": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_commit": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_split": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_merge": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_top": 0, 2024-09-13T18:29:00.061 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_bottom": 0, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pin_tail": 0, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_pinned": 0, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_expired": 0, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "inodes_with_caps": 0, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": 0, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "subtrees": 1, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse": 0, 2024-09-13T18:29:00.062 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_hit": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_forward": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_discover": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_remote_ino": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "traverse_lock": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "load_cent": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "q": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "exported": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "exported_inodes": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "imported": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "imported_inodes": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_dir_fetch": 0, 2024-09-13T18:29:00.063 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "openino_peer_discover": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rfiles": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rbytes": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "root_rsnaps": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_set_tag": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:29:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_file_inodes": 0, 2024-09-13T18:29:00.065 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:29:00.065 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:29:00.065 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:29:00.068 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:29:00.068 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:29:00.068 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:29:00.068 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps": 0, 2024-09-13T18:29:00.068 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:29:00.068 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_cap_release": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "process_request_cap_release": 0 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_cache": { 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_update_receipt": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_try_discover": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_send_discover": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "dir_handle_discover": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_delayed": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:29:00.069 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_created": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_enqueued": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_reintegrated": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "strays_migrated": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_processing": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_started": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "recovery_completed": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_exportdir": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_flush": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:29:00.070 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_fragstats": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "ireq_inodestats": 0 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_log": { 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "evadd": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "evex": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "evtrm": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "ev": 3, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "evexg": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "evexd": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "segadd": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "segex": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "segtrm": 0, 2024-09-13T18:29:00.071 INFO:teuthology.orchestra.run.smithi067.stdout: "seg": 1, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "segexg": 0, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "segexd": 0, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "expos": 4194304, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "wrpos": 4195377, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "rdpos": 4195236, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "jlat": { 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "replayed": 3 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.072 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_mem": { 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "ino": 3, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "ino+": 3, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "ino-": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "dir": 1, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "dir+": 1, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "dir-": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "dn": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "dn+": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "dn-": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "cap": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "cap+": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "cap-": 0, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "rss": 50224, 2024-09-13T18:29:00.073 INFO:teuthology.orchestra.run.smithi067.stdout: "heap": 207124 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_server": { 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_client_request": 0, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "dispatch_server_request": 0, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_request": 0, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_client_session": 0, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "handle_peer_request": 0, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "req_create_latency": { 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.074 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getattr_latency": { 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getfilelock_latency": { 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "req_link_latency": { 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.075 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookup_latency": { 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.076 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookuphash_latency": { 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupino_latency": { 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupname_latency": { 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.077 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupparent_latency": { 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lookupsnap_latency": { 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "req_lssnap_latency": { 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.078 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.079 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.079 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mkdir_latency": { 2024-09-13T18:29:00.079 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.079 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.079 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.079 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.079 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mknod_latency": { 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "req_mksnap_latency": { 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "req_open_latency": { 2024-09-13T18:29:00.080 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "req_readdir_latency": { 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rename_latency": { 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.081 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "req_renamesnap_latency": { 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "req_snapdiff_latency": { 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmdir_latency": { 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.082 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmsnap_latency": { 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "req_rmxattr_latency": { 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.083 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setattr_latency": { 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setdirlayout_latency": { 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setfilelock_latency": { 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.084 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setlayout_latency": { 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "req_setxattr_latency": { 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "req_symlink_latency": { 2024-09-13T18:29:00.085 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "req_unlink_latency": { 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "req_getvxattr_latency": { 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.086 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_sessions": { 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "session_count": 0, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "session_add": 1, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "session_remove": 1, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_open": 1, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "sessions_stale": 0, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "total_load": 0, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "average_load": 0, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "avg_session_uptime": 1385, 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: "mdthresh_evicted": 0 2024-09-13T18:29:00.087 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:29:00.088 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:29:00.089 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:29:00.090 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 189423, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 51, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 7496, 2024-09-13T18:29:00.091 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 154, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 8368, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 13, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.092 INFO:teuthology.orchestra.run.smithi067.stdout: "objecter": { 2024-09-13T18:29:00.093 INFO:teuthology.orchestra.run.smithi067.stdout: "op_active": 0, 2024-09-13T18:29:00.093 INFO:teuthology.orchestra.run.smithi067.stdout: "op_laggy": 0, 2024-09-13T18:29:00.093 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send": 2365, 2024-09-13T18:29:00.093 INFO:teuthology.orchestra.run.smithi067.stdout: "op_send_bytes": 21, 2024-09-13T18:29:00.093 INFO:teuthology.orchestra.run.smithi067.stdout: "op_resend": 3, 2024-09-13T18:29:00.093 INFO:teuthology.orchestra.run.smithi067.stdout: "op_reply": 2365, 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "op_latency": { 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2365, 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 1.145975088, 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000484556 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "op_inflight": 0, 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "oplen_avg": { 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 2365, 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 2366 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.094 INFO:teuthology.orchestra.run.smithi067.stdout: "op": 2365, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "op_r": 2365, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "op_w": 0, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "op_rmw": 0, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "op_pg": 0, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_stat": 1530, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_create": 0, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_read": 833, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_write": 0, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writefull": 0, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_writesame": 0, 2024-09-13T18:29:00.095 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_append": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_zero": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_truncate": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_delete": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_mapext": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_sparse_read": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_clonerange": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_getxattr": 1, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_setxattr": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_rmxattr": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_call": 0, 2024-09-13T18:29:00.096 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_watch": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_notify": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "osdop_other": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_active": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_send": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_resend": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "linger_ping": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_active": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_send": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "poolop_resend": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_active": 0, 2024-09-13T18:29:00.097 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_send": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "poolstat_resend": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_active": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_send": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "statfs_resend": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "command_active": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "command_send": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "command_resend": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "map_epoch": 88, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "map_full": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "map_inc": 2, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_sessions": 5, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_open": 5, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_session_close": 0, 2024-09-13T18:29:00.098 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_laggy": 0, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_wr": 0, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_rd": 2, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_del": 0 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "oft": { 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_objs": 0, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_updates": 0, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "omap_total_removes": 0 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "osd-slow-ops": { 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "slow_ops_count": 0 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.099 INFO:teuthology.orchestra.run.smithi067.stdout: "purge_queue": { 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executing_high_water": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed_ops": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_executed": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "pq_item_in_journal": 0 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:29:00.100 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 2611, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 1194277, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 2611, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 2611, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 1194277, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.101 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_bytes": { 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 2365, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 1078, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 2365, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 1078, 2024-09-13T18:29:00.102 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-objecter_ops": { 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 1024, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:00.103 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 2365, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 2365, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 2365, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 2365, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:29:00.104 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.105 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-write_buf_throttle-0x556514592500": { 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 3758096384, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 0, 2024-09-13T18:29:00.106 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 0, 2024-09-13T18:29:00.107 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-13T18:29:00.107 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-13T18:29:00.107 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-13T18:29:00.107 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-13T18:29:00.107 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.107 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-13T18:29:00.107 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-13T18:29:00.711 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:00 smithi067 ceph-mon[35103]: pgmap v703: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:29:00.732 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-13T18:29:00.732 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-13T18:29:00.732 DEBUG:tasks.check_counter:Getting stats from c 2024-09-13T18:29:00.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-13T18:29:00.762 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:00 smithi116 ceph-mon[35109]: pgmap v703: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:29:00.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:00 smithi007 ceph-mon[30588]: pgmap v703: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:29:00.944 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:29:02.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:02 smithi007 ceph-mon[30588]: pgmap v704: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:02.710 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:02 smithi116 ceph-mon[35109]: pgmap v704: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:02.753 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-13T18:29:02.753 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:29:02.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 302, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 485, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 65490, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 112540, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 8, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.054669887, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.021175705, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.022739245, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.006032294, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 483, 2024-09-13T18:29:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.041865649, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000086678 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 735, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000190443, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000259 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 290, 2024-09-13T18:29:02.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 277, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 794302, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 148646, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.041238189, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.017166952, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.031037923, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000364591, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 277, 2024-09-13T18:29:02.756 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.031270641, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000112890 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 790512, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 136640 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 18, 2024-09-13T18:29:02.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 191, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 3986, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 421827, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 12, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 6, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.013755789, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.007386323, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.004241773, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000111123, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 189, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.016125421, 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000085319 2024-09-13T18:29:02.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 18, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000002964, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000164 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 2016, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 380176 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-13T18:29:02.759 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 58, 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001503742, 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000025926 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000012475, 2024-09-13T18:29:02.760 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000006237 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 0, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 0, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2024-09-13T18:29:02.761 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 11, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 10, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 10, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 10, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2024-09-13T18:29:02.762 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 1, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-09-13T18:29:02.763 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 5, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 298, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:29:02.764 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.765 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 1, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-13T18:29:02.766 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-13T18:29:02.767 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 5, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 5, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 1, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 1, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-13T18:29:02.768 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 4195910, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 5, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.009814892, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001962978 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 13, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 13, 2024-09-13T18:29:02.769 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 0, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 11, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 12, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 1, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 10, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 10, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 0, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 0, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 0, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 48968, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 198932 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-13T18:29:02.770 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 0, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 0, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 8, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-13T18:29:02.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.777 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.781 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.782 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 0, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 2, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 0, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 0, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 0, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 81, 2024-09-13T18:29:02.783 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:29:02.784 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:29:02.785 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:29:02.786 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 230311, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 75, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 7496, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 154, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:29:02.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 50248, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 198, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-13T18:29:02.788 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 42, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 11998, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 27, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 42, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 42, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.233996102, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.005571335 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 42, 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 64 2024-09-13T18:29:02.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 42, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 42, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 10, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 5, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 8, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-13T18:29:02.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 6, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 20, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:29:02.791 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-13T18:29:02.792 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 88, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 2, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 8, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 8, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 14, 2024-09-13T18:29:02.793 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 1 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-13T18:29:02.794 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 606, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 792133, 2024-09-13T18:29:02.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 606, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 606, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 792133, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.796 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 42, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 11998, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 42, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 11998, 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:02.797 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 42, 2024-09-13T18:29:02.798 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 42, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 42, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 42, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:02.799 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x5601404c00a0": { 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 5, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1606, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 5, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 5, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1606, 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:02.801 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:02.802 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:02.802 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:02.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:02.802 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-13T18:29:02.987 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:02 smithi067 ceph-mon[35103]: pgmap v704: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:03.589 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-13T18:29:03.589 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-13T18:29:03.589 DEBUG:tasks.check_counter:Getting stats from f 2024-09-13T18:29:03.589 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-13T18:29:03.826 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:29:04.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:04 smithi007 ceph-mon[30588]: pgmap v705: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-13T18:29:04.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:04 smithi116 ceph-mon[35109]: pgmap v705: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-13T18:29:04.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:04 smithi067 ceph-mon[35103]: pgmap v705: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-13T18:29:05.526 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 553, 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 731, 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 833850, 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 341662, 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 7, 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.093270125, 2024-09-13T18:29:05.527 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.039414516, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.050632194, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.005737774, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 730, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.052799331, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000072327 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 725, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000198332, 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000273 2024-09-13T18:29:05.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 777424, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 136784 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 18, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 193, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 4169, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 430283, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 12, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 6, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.014058622, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.007901310, 2024-09-13T18:29:05.529 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.003799044, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000224495, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 191, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.020572753, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000107710 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 11, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000001350, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000122 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-13T18:29:05.530 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 381376 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 35, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 35, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 12345, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 11606, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 7, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.014065264, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.003085284, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.010091324, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000550687, 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:05.531 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 34, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.023949561, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000704398 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 23, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000004385, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000190 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 7280, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 2832 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.532 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 53, 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001715659, 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000032370 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-13T18:29:05.533 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000011544, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000005772 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 2, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 1, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000097396, 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000097396 2024-09-13T18:29:05.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 1, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 11, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 10, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 10, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 10, 2024-09-13T18:29:05.535 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 1, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 1, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 1, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-09-13T18:29:05.536 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 1, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 5, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 298, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:29:05.537 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2024-09-13T18:29:05.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 1, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-13T18:29:05.539 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-13T18:29:05.540 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 4, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 4, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 1, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 1, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 4195688, 2024-09-13T18:29:05.541 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.007543603, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001885900 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 13, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 13, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 0, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 11, 2024-09-13T18:29:05.542 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 12, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 1, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 10, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 10, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 0, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 1, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 1, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 0, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 48980, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 198932 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 2, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-09-13T18:29:05.543 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 2, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 14, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.544 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000097396, 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000097396 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-13T18:29:05.546 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.547 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.548 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.549 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-13T18:29:05.550 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.552 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.553 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:29:05.554 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 1, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 1, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 0, 2024-09-13T18:29:05.555 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 708, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:29:05.556 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:29:05.557 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:29:05.558 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 246839, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 84, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 7496, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 154, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:29:05.559 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 50616, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 200, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 40, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 11686, 2024-09-13T18:29:05.560 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 27, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 40, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 40, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.210996476, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.005274911 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 40, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 62 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 40, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 0, 2024-09-13T18:29:05.561 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 40, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 10, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 4, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 7, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 6, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-13T18:29:05.562 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 20, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-13T18:29:05.563 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-13T18:29:05.564 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 88, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 2, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 9, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 9, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 14, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 1 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-13T18:29:05.565 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2024-09-13T18:29:05.566 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 0, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 602, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 778820, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 602, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:05.567 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 602, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 778820, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:05.568 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 40, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 11686, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 40, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 11686, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:05.570 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 40, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 40, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 40, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 40, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:05.571 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.572 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55a13a9220a0": { 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 4, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1384, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 4, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 4, 2024-09-13T18:29:05.573 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1384, 2024-09-13T18:29:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:05.574 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-13T18:29:06.234 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-13T18:29:06.234 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-13T18:29:06.234 DEBUG:tasks.check_counter:Getting stats from i 2024-09-13T18:29:06.235 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-13T18:29:06.429 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:29:06.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:06 smithi007 ceph-mon[30588]: pgmap v706: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:06.867 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:06 smithi116 ceph-mon[35109]: pgmap v706: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:06.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:06 smithi067 ceph-mon[35103]: pgmap v706: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:08.091 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-13T18:29:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:29:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 331, 2024-09-13T18:29:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 495, 2024-09-13T18:29:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 70989, 2024-09-13T18:29:08.091 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 99651, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 8, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.056816095, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.021585055, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.024537955, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.006304876, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 493, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.044513742, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000090291 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:08.092 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 777, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000229606, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000295 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 25, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 196, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 8104, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 426312, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 11, 2024-09-13T18:29:08.093 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 6, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.016000065, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.007958188, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.005821691, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000309917, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 195, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.025488874, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000130712 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 15, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000002032, 2024-09-13T18:29:08.094 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000135 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 4736, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 382176 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 284, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 271, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 793619, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 145515, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2024-09-13T18:29:08.095 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.041456062, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.019080256, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.029182785, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000144766, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 270, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.029441544, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000109042 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.096 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 791392, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 136512 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 45, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001374903, 2024-09-13T18:29:08.097 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000030553 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000021150, 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000010575 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 2, 2024-09-13T18:29:08.098 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 1, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000184629, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000184629 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 1, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 11, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-13T18:29:08.099 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 11, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 11, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 10, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 2, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 4, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 2, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 1, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:29:08.100 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 5, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 298, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-13T18:29:08.101 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:29:08.102 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 1 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 2, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:29:08.103 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-13T18:29:08.104 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 3, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 3, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 1, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 1, 2024-09-13T18:29:08.105 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 4195377, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.005279883, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001759961 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 14, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 14, 2024-09-13T18:29:08.106 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 0, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 12, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 13, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 1, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 11, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 11, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 0, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 1, 2024-09-13T18:29:08.107 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 1, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 49340, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 198932 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 3, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 2, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 4, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000184629, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000184629 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.109 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.110 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.112 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-13T18:29:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-13T18:29:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 0, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 1, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 1, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 0, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 1, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 1, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 86, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-13T18:29:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-13T18:29:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:29:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 246663, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 81, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-13T18:29:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 7496, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 154, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 54408, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 213, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-13T18:29:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 38, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 11285, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 29, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 38, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 38, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.217996361, 2024-09-13T18:29:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.005736746 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 38, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 60 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 38, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 0, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 38, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-09-13T18:29:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 10, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 3, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 6, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 6, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-09-13T18:29:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 20, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-13T18:29:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-13T18:29:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 88, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 2, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 9, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 9, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 14, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 1 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:29:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 0, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-13T18:29:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 636, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 798275, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 636, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 636, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 798275, 2024-09-13T18:29:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 38, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 11285, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 38, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 11285, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 38, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 38, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 38, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 38, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55ce34f140a0": { 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 3, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1073, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 3, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 3, 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1073, 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-13T18:29:08.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:08 smithi007 ceph-mon[30588]: pgmap v707: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:08.905 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:08 smithi116 ceph-mon[35109]: pgmap v707: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:08.925 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-13T18:29:08.925 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-13T18:29:08.925 DEBUG:tasks.check_counter:Getting stats from l 2024-09-13T18:29:08.925 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid d9377e86-71fa-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-13T18:29:08.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:08 smithi067 ceph-mon[35103]: pgmap v707: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:09.121 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:29:10.747 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:10 smithi116 ceph-mon[35109]: pgmap v708: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:29:10.747 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-13T18:29:10.747 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 844, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 846, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 223309, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 262548, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 6, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 2, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.076590545, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.027330573, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.019408021, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.021030367, 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:10.748 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 844, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.036586788, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000043349 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:29:10.749 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 754, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 932, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 185420, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 615356, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.079728208, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.029745567, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.016650683, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.024834193, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 930, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.036982284, 2024-09-13T18:29:10.750 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000039765 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 381168 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 1089, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 1081, 2024-09-13T18:29:10.751 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1055488, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 396067, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 3, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 2, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.146363299, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.048709794, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.059358197, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.035557857, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1081, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.069349554, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000064153 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 774256, 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 135760 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-09-13T18:29:10.753 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4018, 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.124736216, 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000031044 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-09-13T18:29:10.754 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 0, 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 0, 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.755 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 0, 2024-09-13T18:29:10.756 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 1, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2024-09-13T18:29:10.757 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 0, 2024-09-13T18:29:10.758 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:29:10.759 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-09-13T18:29:10.760 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-09-13T18:29:10.761 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-09-13T18:29:10.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 5, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 1, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 4195910, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 4195769, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.763 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 5 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 3, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 3, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 0, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 1, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 1, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 0, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 0, 2024-09-13T18:29:10.764 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 48032, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 207124 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2024-09-13T18:29:10.765 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.767 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.768 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.770 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-09-13T18:29:10.770 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.770 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.770 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.770 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-09-13T18:29:10.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.773 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-09-13T18:29:10.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:29:10.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 0, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 2, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 0, 2024-09-13T18:29:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 1393, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:29:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:29:10.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:29:10.781 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 189423, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 51, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 7496, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 154, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:29:10.782 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 8368, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 13, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 2434, 2024-09-13T18:29:10.783 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 21, 2024-09-13T18:29:10.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 3, 2024-09-13T18:29:10.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 2434, 2024-09-13T18:29:10.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-09-13T18:29:10.784 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2434, 2024-09-13T18:29:10.784 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.168980562, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000480271 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2434, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 2435 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 2434, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 2434, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 0, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 1588, 2024-09-13T18:29:10.785 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 844, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 1, 2024-09-13T18:29:10.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-09-13T18:29:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 88, 2024-09-13T18:29:10.788 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 2, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 5, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 5, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 0, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 2, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 0 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 0, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:29:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 0, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-09-13T18:29:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 2683, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1207024, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 2683, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 2683, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1207024, 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:10.791 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:10.792 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 2434, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 1611, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 2434, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1611, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.793 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 2434, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 2434, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 2434, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 2434, 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:10.794 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:10.795 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55ad85b98460": { 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-09-13T18:29:10.796 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-13T18:29:10.797 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-13T18:29:10.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:10 smithi007 ceph-mon[30588]: pgmap v708: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:29:10.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:10 smithi067 ceph-mon[35103]: pgmap v708: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:29:11.525 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-13T18:29:11.525 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-13T18:29:11.525 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T18:29:11.535 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T18:29:11.535 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:29:11.535 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:11.578 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T18:29:11.578 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:11.657 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 -- 172.21.15.7:0/2762105513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 msgr2=0x7fa4e0103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 --2- 172.21.15.7:0/2762105513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0103470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009900 tx=0x7fa4cc02a410 comp rx=0 tx=0).stop 2024-09-13T18:29:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 -- 172.21.15.7:0/2762105513 shutdown_connections 2024-09-13T18:29:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 --2- 172.21.15.7:0/2762105513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4e01039b0 0x7fa4e010a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 --2- 172.21.15.7:0/2762105513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0103470 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 --2- 172.21.15.7:0/2762105513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4e0101e00 0x7fa4e0102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 -- 172.21.15.7:0/2762105513 >> 172.21.15.7:0/2762105513 conn(0x7fa4e00fd580 msgr2=0x7fa4e00ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 -- 172.21.15.7:0/2762105513 shutdown_connections 2024-09-13T18:29:11.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.859+0000 7fa4e6600640 1 -- 172.21.15.7:0/2762105513 wait complete. 2024-09-13T18:29:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 Processor -- start 2024-09-13T18:29:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 -- start start 2024-09-13T18:29:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4e0101e00 0x7fa4e0197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4e01039b0 0x7fa4e019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e019f8f0 con 0x7fa4e0102ff0 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e019fa60 con 0x7fa4e0101e00 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.860+0000 7fa4e6600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e019fc20 con 0x7fa4e01039b0 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59668/0 (socket says 172.21.15.7:59668) 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 -- 172.21.15.7:0/1188440226 learned_addr learned my addr 172.21.15.7:0/1188440226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4e5200640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4e0101e00 0x7fa4e0197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4e5c00640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4e01039b0 0x7fa4e019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 -- 172.21.15.7:0/1188440226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4e01039b0 msgr2=0x7fa4e019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4e01039b0 0x7fa4e019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 -- 172.21.15.7:0/1188440226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4e0101e00 msgr2=0x7fa4e0197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4e0101e00 0x7fa4e0197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 -- 172.21.15.7:0/1188440226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc009560 con 0x7fa4e0102ff0 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4e5200640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4e0101e00 0x7fa4e0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.861+0000 7fa4dfe00640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0198340 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc031500 tx=0x7fa4cc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.862+0000 7fa4dd600640 1 -- 172.21.15.7:0/1188440226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc003e00 con 0x7fa4e0102ff0 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.862+0000 7fa4dd600640 1 -- 172.21.15.7:0/1188440226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4cc031c70 con 0x7fa4e0102ff0 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.862+0000 7fa4dd600640 1 -- 172.21.15.7:0/1188440226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc03bc20 con 0x7fa4e0102ff0 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.862+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e019fea0 con 0x7fa4e0102ff0 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.862+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e01a0270 con 0x7fa4e0102ff0 2024-09-13T18:29:11.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.863+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e0109330 con 0x7fa4e0102ff0 2024-09-13T18:29:11.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.865+0000 7fa4dd600640 1 -- 172.21.15.7:0/1188440226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fa4cc0317b0 con 0x7fa4e0102ff0 2024-09-13T18:29:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.866+0000 7fa4dd600640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4c80a1090 0x7fa4c80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.866+0000 7fa4dd600640 1 -- 172.21.15.7:0/1188440226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa4cc0ed120 con 0x7fa4e0102ff0 2024-09-13T18:29:11.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.866+0000 7fa4e5200640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4c80a1090 0x7fa4c80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.867+0000 7fa4e5200640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4c80a1090 0x7fa4c80a3550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0102e50 tx=0x7fa4d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:11.870+0000 7fa4dd600640 1 -- 172.21.15.7:0/1188440226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4cc0b6910 con 0x7fa4e0102ff0 2024-09-13T18:29:12.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.054+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4e010d6f0 con 0x7fa4e0102ff0 2024-09-13T18:29:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.055+0000 7fa4dd600640 1 -- 172.21.15.7:0/1188440226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7fa4cc0b9f30 con 0x7fa4e0102ff0 2024-09-13T18:29:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:29:12.059 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4c80a1090 msgr2=0x7fa4c80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4c80a1090 0x7fa4c80a3550 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0102e50 tx=0x7fa4d4005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 msgr2=0x7fa4e0198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0198340 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc031500 tx=0x7fa4cc003c10 comp rx=0 tx=0).stop 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 shutdown_connections 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa4c80a1090 0x7fa4c80a3550 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4e01039b0 0x7fa4e019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4e0102ff0 0x7fa4e0198340 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 --2- 172.21.15.7:0/1188440226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4e0101e00 0x7fa4e0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 >> 172.21.15.7:0/1188440226 conn(0x7fa4e00fd580 msgr2=0x7fa4e0106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 shutdown_connections 2024-09-13T18:29:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.058+0000 7fa4e6600640 1 -- 172.21.15.7:0/1188440226 wait complete. 2024-09-13T18:29:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:10:37.028462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:15:04.217247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:15:05.500183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:12.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 -- 172.21.15.7:0/4126815154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 msgr2=0x7f03ec10a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 --2- 172.21.15.7:0/4126815154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 0x7f03ec10a410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009ca0 tx=0x7f03e802a8b0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 -- 172.21.15.7:0/4126815154 shutdown_connections 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 --2- 172.21.15.7:0/4126815154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 0x7f03ec10a410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 --2- 172.21.15.7:0/4126815154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec1031c0 0x7f03ec103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 --2- 172.21.15.7:0/4126815154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec101fd0 0x7f03ec1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 -- 172.21.15.7:0/4126815154 >> 172.21.15.7:0/4126815154 conn(0x7f03ec0fd730 msgr2=0x7f03ec0ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 -- 172.21.15.7:0/4126815154 shutdown_connections 2024-09-13T18:29:12.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.236+0000 7f03f4800640 1 -- 172.21.15.7:0/4126815154 wait complete. 2024-09-13T18:29:12.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 Processor -- start 2024-09-13T18:29:12.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 -- start start 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec101fd0 0x7f03ec197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec1031c0 0x7f03ec198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 0x7f03ec19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec19f9d0 con 0x7f03ec103b80 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec19fb40 con 0x7f03ec101fd0 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.237+0000 7f03f4800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec19fd00 con 0x7f03ec1031c0 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec101fd0 0x7f03ec197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec101fd0 0x7f03ec197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:56240/0 (socket says 172.21.15.7:56240) 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 -- 172.21.15.7:0/3888448008 learned_addr learned my addr 172.21.15.7:0/3888448008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f2800640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 0x7f03ec19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1400640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec1031c0 0x7f03ec198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 -- 172.21.15.7:0/3888448008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec1031c0 msgr2=0x7f03ec198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec1031c0 0x7f03ec198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 -- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 msgr2=0x7f03ec19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 0x7f03ec19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 -- 172.21.15.7:0/3888448008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc009490 con 0x7f03ec101fd0 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03f1e00640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec101fd0 0x7f03ec197ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e9c0 tx=0x7f03e000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.238+0000 7f03e6a00640 1 -- 172.21.15.7:0/3888448008 <== mon.2 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0009700 con 0x7f03ec101fd0 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.239+0000 7f03e6a00640 1 -- 172.21.15.7:0/3888448008 <== mon.2 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03e00044e0 con 0x7f03ec101fd0 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.239+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e8009900 con 0x7f03ec101fd0 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.239+0000 7f03e6a00640 1 -- 172.21.15.7:0/3888448008 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0010430 con 0x7f03ec101fd0 2024-09-13T18:29:12.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.239+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1a0270 con 0x7f03ec101fd0 2024-09-13T18:29:12.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.240+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec1023d0 con 0x7f03ec101fd0 2024-09-13T18:29:12.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.242+0000 7f03e6a00640 1 -- 172.21.15.7:0/3888448008 <== mon.2 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f03e0003f40 con 0x7f03ec101fd0 2024-09-13T18:29:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.243+0000 7f03e6a00640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03d40a1090 0x7f03d40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.243+0000 7f03e6a00640 1 -- 172.21.15.7:0/3888448008 <== mon.2 v2:172.21.15.67:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f03e0014070 con 0x7f03ec101fd0 2024-09-13T18:29:12.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.243+0000 7f03f1400640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03d40a1090 0x7f03d40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.244+0000 7f03f1400640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03d40a1090 0x7f03d40a3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f03ec1993f0 tx=0x7f03dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.245+0000 7f03e6a00640 1 -- 172.21.15.7:0/3888448008 <== mon.2 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03e0096590 con 0x7f03ec101fd0 2024-09-13T18:29:12.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.425+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03ec10d870 con 0x7f03ec101fd0 2024-09-13T18:29:12.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.427+0000 7f03e6a00640 1 -- 172.21.15.7:0/3888448008 <== mon.2 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03e0094e60 con 0x7f03ec101fd0 2024-09-13T18:29:12.430 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T18:29:12.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03d40a1090 msgr2=0x7f03d40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03d40a1090 0x7f03d40a3550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f03ec1993f0 tx=0x7f03dc005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:12.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec101fd0 msgr2=0x7f03ec197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec101fd0 0x7f03ec197ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e9c0 tx=0x7f03e000ee80 comp rx=0 tx=0).stop 2024-09-13T18:29:12.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 shutdown_connections 2024-09-13T18:29:12.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f03d40a1090 0x7f03d40a3550 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03ec103b80 0x7f03ec19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec1031c0 0x7f03ec198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 --2- 172.21.15.7:0/3888448008 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03ec101fd0 0x7f03ec197ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 >> 172.21.15.7:0/3888448008 conn(0x7f03ec0fd730 msgr2=0x7f03ec1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 shutdown_connections 2024-09-13T18:29:12.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.429+0000 7f03f4800640 1 -- 172.21.15.7:0/3888448008 wait complete. 2024-09-13T18:29:12.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:12.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.607+0000 7f3c00e00640 1 -- 172.21.15.7:0/2987962003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 msgr2=0x7f3bfc10a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.607+0000 7f3c00e00640 1 --2- 172.21.15.7:0/2987962003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc10a3e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009ca0 tx=0x7f3bf402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.607+0000 7f3c00e00640 1 -- 172.21.15.7:0/2987962003 shutdown_connections 2024-09-13T18:29:12.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.607+0000 7f3c00e00640 1 --2- 172.21.15.7:0/2987962003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc10a3e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.607+0000 7f3c00e00640 1 --2- 172.21.15.7:0/2987962003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bfc103190 0x7f3bfc103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.607+0000 7f3c00e00640 1 --2- 172.21.15.7:0/2987962003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bfc101fa0 0x7f3bfc1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.607+0000 7f3c00e00640 1 -- 172.21.15.7:0/2987962003 >> 172.21.15.7:0/2987962003 conn(0x7f3bfc0fd720 msgr2=0x7f3bfc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.608+0000 7f3c00e00640 1 -- 172.21.15.7:0/2987962003 shutdown_connections 2024-09-13T18:29:12.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.608+0000 7f3c00e00640 1 -- 172.21.15.7:0/2987962003 wait complete. 2024-09-13T18:29:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.608+0000 7f3c00e00640 1 Processor -- start 2024-09-13T18:29:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3c00e00640 1 -- start start 2024-09-13T18:29:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3c00e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bfc101fa0 0x7f3bfc197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3c00e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bfc103190 0x7f3bfc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3c00e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3c00e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19fa00 con 0x7f3bfc103b50 2024-09-13T18:29:12.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3c00e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19fb70 con 0x7f3bfc103190 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3c00e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19fd30 con 0x7f3bfc101fa0 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bfa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bfa800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc19f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59708/0 (socket says 172.21.15.7:59708) 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bfa800640 1 -- 172.21.15.7:0/4231406234 learned_addr learned my addr 172.21.15.7:0/4231406234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bf9e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bfc101fa0 0x7f3bfc197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bf3e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bfc103190 0x7f3bfc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bfa800640 1 -- 172.21.15.7:0/4231406234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bfc101fa0 msgr2=0x7f3bfc197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bfa800640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bfc101fa0 0x7f3bfc197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bfa800640 1 -- 172.21.15.7:0/4231406234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bfc103190 msgr2=0x7f3bfc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.609+0000 7f3bfa800640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bfc103190 0x7f3bfc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3bfa800640 1 -- 172.21.15.7:0/4231406234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009900 con 0x7f3bfc103b50 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3bf9e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bfc101fa0 0x7f3bfc197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:12.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3bfa800640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc19f4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bf402ade0 tx=0x7f3bf4032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3bf2a00640 1 -- 172.21.15.7:0/4231406234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4003b70 con 0x7f3bfc103b50 2024-09-13T18:29:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3bf2a00640 1 -- 172.21.15.7:0/4231406234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bf4040070 con 0x7f3bfc103b50 2024-09-13T18:29:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc19ffb0 con 0x7f3bfc103b50 2024-09-13T18:29:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3bf2a00640 1 -- 172.21.15.7:0/4231406234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40043c0 con 0x7f3bfc103b50 2024-09-13T18:29:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.610+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc1a0480 con 0x7f3bfc103b50 2024-09-13T18:29:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.612+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc1093e0 con 0x7f3bfc103b50 2024-09-13T18:29:12.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.613+0000 7f3bf2a00640 1 -- 172.21.15.7:0/4231406234 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f3bf4042030 con 0x7f3bfc103b50 2024-09-13T18:29:12.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.614+0000 7f3bf2a00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3be00a1110 0x7f3be00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.615+0000 7f3bf2a00640 1 -- 172.21.15.7:0/4231406234 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3bf40ede40 con 0x7f3bfc103b50 2024-09-13T18:29:12.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.615+0000 7f3bf9e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3be00a1110 0x7f3be00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.615+0000 7f3bf9e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3be00a1110 0x7f3be00a35d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc102ff0 tx=0x7f3bec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.619+0000 7f3bf2a00640 1 -- 172.21.15.7:0/4231406234 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3bf40b7730 con 0x7f3bfc103b50 2024-09-13T18:29:12.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:12 smithi007 ceph-mon[30588]: pgmap v709: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:12.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:12 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/1188440226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:29:12.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:12 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3888448008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:29:12.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.799+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bfc02c410 con 0x7f3bfc103b50 2024-09-13T18:29:12.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.800+0000 7f3bf2a00640 1 -- 172.21.15.7:0/4231406234 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bf40bad50 con 0x7f3bfc103b50 2024-09-13T18:29:12.803 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T18:29:12.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3be00a1110 msgr2=0x7f3be00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3be00a1110 0x7f3be00a35d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc102ff0 tx=0x7f3bec005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:12.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 msgr2=0x7f3bfc19f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc19f4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bf402ade0 tx=0x7f3bf4032f20 comp rx=0 tx=0).stop 2024-09-13T18:29:12.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 shutdown_connections 2024-09-13T18:29:12.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f3be00a1110 0x7f3be00a35d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3bfc103b50 0x7f3bfc19f4c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3bfc103190 0x7f3bfc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 --2- 172.21.15.7:0/4231406234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bfc101fa0 0x7f3bfc197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 >> 172.21.15.7:0/4231406234 conn(0x7f3bfc0fd720 msgr2=0x7f3bfc1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 shutdown_connections 2024-09-13T18:29:12.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.802+0000 7f3c00e00640 1 -- 172.21.15.7:0/4231406234 wait complete. 2024-09-13T18:29:12.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:12.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:12 smithi116 ceph-mon[35109]: pgmap v709: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:12 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/1188440226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:29:12.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:12 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3888448008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:29:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 -- 172.21.15.7:0/4177316884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8103190 msgr2=0x7fdaf8103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 --2- 172.21.15.7:0/4177316884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8103190 0x7fdaf8103610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009900 tx=0x7fdae002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 -- 172.21.15.7:0/4177316884 shutdown_connections 2024-09-13T18:29:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 --2- 172.21.15.7:0/4177316884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaf8103b50 0x7fdaf810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 --2- 172.21.15.7:0/4177316884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8103190 0x7fdaf8103610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 --2- 172.21.15.7:0/4177316884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaf8101fa0 0x7fdaf81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 -- 172.21.15.7:0/4177316884 >> 172.21.15.7:0/4177316884 conn(0x7fdaf80fd720 msgr2=0x7fdaf80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 -- 172.21.15.7:0/4177316884 shutdown_connections 2024-09-13T18:29:12.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.980+0000 7fdafcc00640 1 -- 172.21.15.7:0/4177316884 wait complete. 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 Processor -- start 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 -- start start 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8101fa0 0x7fdaf8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaf8103190 0x7fdaf8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaf8103b50 0x7fdaf819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf819fa10 con 0x7fdaf8101fa0 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf819fb80 con 0x7fdaf8103190 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdafcc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf819fd40 con 0x7fdaf8103b50 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdaf5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8101fa0 0x7fdaf8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdaf5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8101fa0 0x7fdaf8197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59738/0 (socket says 172.21.15.7:59738) 2024-09-13T18:29:12.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdaf5e00640 1 -- 172.21.15.7:0/3675401973 learned_addr learned my addr 172.21.15.7:0/3675401973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:12.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdaf6800640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaf8103b50 0x7fdaf819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.981+0000 7fdaefe00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaf8103190 0x7fdaf8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaf5e00640 1 -- 172.21.15.7:0/3675401973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaf8103b50 msgr2=0x7fdaf819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaf5e00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaf8103b50 0x7fdaf819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaf5e00640 1 -- 172.21.15.7:0/3675401973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaf8103190 msgr2=0x7fdaf8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaf5e00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaf8103190 0x7fdaf8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaf5e00640 1 -- 172.21.15.7:0/3675401973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8009490 con 0x7fdaf8101fa0 2024-09-13T18:29:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaf6800640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaf8103b50 0x7fdaf819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:12.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaf5e00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8101fa0 0x7fdaf8197f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e9c0 tx=0x7fdae800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaeea00640 1 -- 172.21.15.7:0/3675401973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae800cde0 con 0x7fdaf8101fa0 2024-09-13T18:29:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae0009560 con 0x7fdaf8101fa0 2024-09-13T18:29:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaeea00640 1 -- 172.21.15.7:0/3675401973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdae80108f0 con 0x7fdaf8101fa0 2024-09-13T18:29:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdaeea00640 1 -- 172.21.15.7:0/3675401973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae80188c0 con 0x7fdaf8101fa0 2024-09-13T18:29:12.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.982+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf81a02b0 con 0x7fdaf8101fa0 2024-09-13T18:29:12.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.983+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf8109400 con 0x7fdaf8101fa0 2024-09-13T18:29:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.985+0000 7fdaeea00640 1 -- 172.21.15.7:0/3675401973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fdae8010a60 con 0x7fdaf8101fa0 2024-09-13T18:29:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.987+0000 7fdaeea00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdadc0a1090 0x7fdadc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.987+0000 7fdaeea00640 1 -- 172.21.15.7:0/3675401973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdae8014070 con 0x7fdaf8101fa0 2024-09-13T18:29:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.987+0000 7fdaefe00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdadc0a1090 0x7fdadc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.988+0000 7fdaefe00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdadc0a1090 0x7fdadc0a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdae002a9e0 tx=0x7fdae00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:12.991+0000 7fdaeea00640 1 -- 172.21.15.7:0/3675401973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdae8096600 con 0x7fdaf8101fa0 2024-09-13T18:29:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:12 smithi067 ceph-mon[35103]: pgmap v709: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-13T18:29:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:12 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/1188440226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:29:12.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:12 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3888448008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:29:13.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.171+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdaf802c4b0 con 0x7fdaf8101fa0 2024-09-13T18:29:13.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.172+0000 7fdaeea00640 1 -- 172.21.15.7:0/3675401973 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdae8099c20 con 0x7fdaf8101fa0 2024-09-13T18:29:13.175 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T18:29:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdadc0a1090 msgr2=0x7fdadc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdadc0a1090 0x7fdadc0a3550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdae002a9e0 tx=0x7fdae00314a0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8101fa0 msgr2=0x7fdaf8197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8101fa0 0x7fdaf8197f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e9c0 tx=0x7fdae800ee80 comp rx=0 tx=0).stop 2024-09-13T18:29:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 shutdown_connections 2024-09-13T18:29:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fdadc0a1090 0x7fdadc0a3550 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdaf8103b50 0x7fdaf819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaf8103190 0x7fdaf8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 --2- 172.21.15.7:0/3675401973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdaf8101fa0 0x7fdaf8197f20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 >> 172.21.15.7:0/3675401973 conn(0x7fdaf80fd720 msgr2=0x7fdaf81065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 shutdown_connections 2024-09-13T18:29:13.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.174+0000 7fdafcc00640 1 -- 172.21.15.7:0/3675401973 wait complete. 2024-09-13T18:29:13.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:29:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.351+0000 7fb2d8600640 1 -- 172.21.15.7:0/769487099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 msgr2=0x7fb2d0108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.351+0000 7fb2d8600640 1 --2- 172.21.15.7:0/769487099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d0108200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009ca0 tx=0x7fb2c802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.352+0000 7fb2d8600640 1 -- 172.21.15.7:0/769487099 shutdown_connections 2024-09-13T18:29:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.352+0000 7fb2d8600640 1 --2- 172.21.15.7:0/769487099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d0108200 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.352+0000 7fb2d8600640 1 --2- 172.21.15.7:0/769487099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d0100fb0 0x7fb2d0101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.352+0000 7fb2d8600640 1 --2- 172.21.15.7:0/769487099 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d00ffdc0 0x7fb2d01001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.352+0000 7fb2d8600640 1 -- 172.21.15.7:0/769487099 >> 172.21.15.7:0/769487099 conn(0x7fb2d00fb560 msgr2=0x7fb2d00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.352+0000 7fb2d8600640 1 -- 172.21.15.7:0/769487099 shutdown_connections 2024-09-13T18:29:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.352+0000 7fb2d8600640 1 -- 172.21.15.7:0/769487099 wait complete. 2024-09-13T18:29:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 Processor -- start 2024-09-13T18:29:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 -- start start 2024-09-13T18:29:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d00ffdc0 0x7fb2d0195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d0100fb0 0x7fb2d0196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d019d7e0 con 0x7fb2d0101970 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d019d950 con 0x7fb2d0100fb0 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d8600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d019db10 con 0x7fb2d00ffdc0 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d019d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d5c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d00ffdc0 0x7fb2d0195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d019d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59764/0 (socket says 172.21.15.7:59764) 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d6600640 1 -- 172.21.15.7:0/4070291787 learned_addr learned my addr 172.21.15.7:0/4070291787 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.353+0000 7fb2d5200640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d0100fb0 0x7fb2d0196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2d6600640 1 -- 172.21.15.7:0/4070291787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d00ffdc0 msgr2=0x7fb2d0195d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2d6600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d00ffdc0 0x7fb2d0195d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2d6600640 1 -- 172.21.15.7:0/4070291787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d0100fb0 msgr2=0x7fb2d0196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2d6600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d0100fb0 0x7fb2d0196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2d6600640 1 -- 172.21.15.7:0/4070291787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009900 con 0x7fb2d0101970 2024-09-13T18:29:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2d6600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d019d270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb2c802aeb0 tx=0x7fb2c8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2ce000640 1 -- 172.21.15.7:0/4070291787 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c80307c0 con 0x7fb2d0101970 2024-09-13T18:29:13.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2ce000640 1 -- 172.21.15.7:0/4070291787 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2c8040070 con 0x7fb2d0101970 2024-09-13T18:29:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d019dd90 con 0x7fb2d0101970 2024-09-13T18:29:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.354+0000 7fb2ce000640 1 -- 172.21.15.7:0/4070291787 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c80044a0 con 0x7fb2d0101970 2024-09-13T18:29:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.355+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d019e260 con 0x7fb2d0101970 2024-09-13T18:29:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.356+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d0107200 con 0x7fb2d0101970 2024-09-13T18:29:13.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.358+0000 7fb2ce000640 1 -- 172.21.15.7:0/4070291787 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fb2c8042030 con 0x7fb2d0101970 2024-09-13T18:29:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.359+0000 7fb2ce000640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2b80a1110 0x7fb2b80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.359+0000 7fb2ce000640 1 -- 172.21.15.7:0/4070291787 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb2c80edfa0 con 0x7fb2d0101970 2024-09-13T18:29:13.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.359+0000 7fb2d5c00640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2b80a1110 0x7fb2b80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.360+0000 7fb2d5c00640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2b80a1110 0x7fb2b80a35d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2d01971d0 tx=0x7fb2c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.362+0000 7fb2ce000640 1 -- 172.21.15.7:0/4070291787 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb2c80b7650 con 0x7fb2d0101970 2024-09-13T18:29:13.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.560+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb2d002c3e0 con 0x7fb2d0101970 2024-09-13T18:29:13.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.561+0000 7fb2ce000640 1 -- 172.21.15.7:0/4070291787 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+580 (secure 0 0 0) 0x7fb2c80b9580 con 0x7fb2d0101970 2024-09-13T18:29:13.563 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1716014046 2024-09-14T18:08:08.423245+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3391098565 2024-09-14T18:08:08.423245+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1721886388 2024-09-14T18:08:08.423245+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2474200435 2024-09-14T18:08:08.423245+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2450025711 2024-09-14T18:07:40.349994+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3391098565 2024-09-14T18:08:08.423245+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3768640508 2024-09-14T18:07:40.349994+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3365645542 2024-09-14T18:07:40.349994+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/568921109 2024-09-14T18:07:40.349994+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/568921109 2024-09-14T18:07:40.349994+0000 2024-09-13T18:29:13.564 INFO:teuthology.orchestra.run.smithi007.stderr:listed 10 entries 2024-09-13T18:29:13.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2b80a1110 msgr2=0x7fb2b80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2b80a1110 0x7fb2b80a35d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2d01971d0 tx=0x7fb2c4005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:13.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 msgr2=0x7fb2d019d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d019d270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb2c802aeb0 tx=0x7fb2c8003c20 comp rx=0 tx=0).stop 2024-09-13T18:29:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 shutdown_connections 2024-09-13T18:29:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fb2b80a1110 0x7fb2b80a35d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2d0101970 0x7fb2d019d270 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2d0100fb0 0x7fb2d0196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 --2- 172.21.15.7:0/4070291787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2d00ffdc0 0x7fb2d0195d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.563+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 >> 172.21.15.7:0/4070291787 conn(0x7fb2d00fb560 msgr2=0x7fb2d01043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.564+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 shutdown_connections 2024-09-13T18:29:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:13.564+0000 7fb2d8600640 1 -- 172.21.15.7:0/4070291787 wait complete. 2024-09-13T18:29:13.582 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:29:13.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:13.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:13.675 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T18:29:13.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:13.675 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:29:13.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:13.724 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-13T18:29:13.759 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:29:13.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:13.759 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:29:13.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:13 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/4231406234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:29:13.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:13 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3675401973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:29:13.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:13.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-13T18:29:13.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:13 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/4231406234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:29:13.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:13 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3675401973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:29:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:13 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/4231406234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:29:13.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:13 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3675401973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:29:14.192 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T18:29:14.205 INFO:tasks.cephadm:Teardown begin 2024-09-13T18:29:14.206 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:29:14.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:14.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 -- 172.21.15.7:0/1229012603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe210072f10 msgr2=0x7fe210073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 --2- 172.21.15.7:0/1229012603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe210072f10 0x7fe210073370 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009900 tx=0x7fe1fc02a410 comp rx=0 tx=0).stop 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 -- 172.21.15.7:0/1229012603 shutdown_connections 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 --2- 172.21.15.7:0/1229012603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe21010c1c0 0x7fe21010e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 --2- 172.21.15.7:0/1229012603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe210072f10 0x7fe210073370 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 --2- 172.21.15.7:0/1229012603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2100744f0 0x7fe210072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 -- 172.21.15.7:0/1229012603 >> 172.21.15.7:0/1229012603 conn(0x7fe2100fb390 msgr2=0x7fe2100fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 -- 172.21.15.7:0/1229012603 shutdown_connections 2024-09-13T18:29:14.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.364+0000 7fe20fe00640 1 -- 172.21.15.7:0/1229012603 wait complete. 2024-09-13T18:29:14.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 Processor -- start 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 -- start start 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe210072f10 0x7fe21019c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2100744f0 0x7fe21019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe21010c1c0 0x7fe2101a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101a3d20 con 0x7fe21010c1c0 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101a3e90 con 0x7fe210072f10 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101a4050 con 0x7fe2100744f0 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe21010c1c0 0x7fe2101a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.365+0000 7fe20ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe210072f10 0x7fe21019c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe210072f10 0x7fe21019c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.7:40018/0 (socket says 172.21.15.7:40018) 2024-09-13T18:29:14.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20ea00640 1 -- 172.21.15.7:0/104587335 learned_addr learned my addr 172.21.15.7:0/104587335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20e000640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2100744f0 0x7fe21019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20f400640 1 -- 172.21.15.7:0/104587335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2100744f0 msgr2=0x7fe21019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20f400640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2100744f0 0x7fe21019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20f400640 1 -- 172.21.15.7:0/104587335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe210072f10 msgr2=0x7fe21019c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20f400640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe210072f10 0x7fe21019c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20f400640 1 -- 172.21.15.7:0/104587335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc009560 con 0x7fe21010c1c0 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20ea00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe210072f10 0x7fe21019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20f400640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe21010c1c0 0x7fe2101a37e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe208009fd0 tx=0x7fe20800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe207400640 1 -- 172.21.15.7:0/104587335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20800ce20 con 0x7fe21010c1c0 2024-09-13T18:29:14.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe207400640 1 -- 172.21.15.7:0/104587335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe208005020 con 0x7fe21010c1c0 2024-09-13T18:29:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.366+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2101a4330 con 0x7fe21010c1c0 2024-09-13T18:29:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.367+0000 7fe207400640 1 -- 172.21.15.7:0/104587335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208010670 con 0x7fe21010c1c0 2024-09-13T18:29:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.367+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2101a4860 con 0x7fe21010c1c0 2024-09-13T18:29:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.368+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe210102390 con 0x7fe21010c1c0 2024-09-13T18:29:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.369+0000 7fe207400640 1 -- 172.21.15.7:0/104587335 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fe208005450 con 0x7fe21010c1c0 2024-09-13T18:29:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.371+0000 7fe207400640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe1f40a1110 0x7fe1f40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.371+0000 7fe207400640 1 -- 172.21.15.7:0/104587335 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe208014070 con 0x7fe21010c1c0 2024-09-13T18:29:14.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.371+0000 7fe20ea00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe1f40a1110 0x7fe1f40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.372+0000 7fe20ea00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe1f40a1110 0x7fe1f40a35d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe200011550 tx=0x7fe200005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.375+0000 7fe207400640 1 -- 172.21.15.7:0/104587335 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe208096680 con 0x7fe21010c1c0 2024-09-13T18:29:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.594+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe210111b30 con 0x7fe21010c1c0 2024-09-13T18:29:14.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.594+0000 7fe207400640 1 -- 172.21.15.7:0/104587335 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10889 (secure 0 0 0) 0x7fe208099ca0 con 0x7fe21010c1c0 2024-09-13T18:29:14.597 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:29:14.597 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:17:16.238743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:29:14.597 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-13T18:29:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe1f40a1110 msgr2=0x7fe1f40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe1f40a1110 0x7fe1f40a35d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe200011550 tx=0x7fe200005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:14.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe21010c1c0 msgr2=0x7fe2101a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe21010c1c0 0x7fe2101a37e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe208009fd0 tx=0x7fe20800ef10 comp rx=0 tx=0).stop 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 shutdown_connections 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fe1f40a1110 0x7fe1f40a35d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe21010c1c0 0x7fe2101a37e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2100744f0 0x7fe21019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 --2- 172.21.15.7:0/104587335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe210072f10 0x7fe21019c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 >> 172.21.15.7:0/104587335 conn(0x7fe2100fb390 msgr2=0x7fe2100ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 shutdown_connections 2024-09-13T18:29:14.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.597+0000 7fe20fe00640 1 -- 172.21.15.7:0/104587335 wait complete. 2024-09-13T18:29:14.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 -- 172.21.15.7:0/2824792926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc102000 msgr2=0x7f46cc102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 --2- 172.21.15.7:0/2824792926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc102000 0x7f46cc102400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009900 tx=0x7f46bc02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 -- 172.21.15.7:0/2824792926 shutdown_connections 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 --2- 172.21.15.7:0/2824792926 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc103bb0 0x7f46cc10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 --2- 172.21.15.7:0/2824792926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc1031f0 0x7f46cc103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 --2- 172.21.15.7:0/2824792926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc102000 0x7f46cc102400 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 -- 172.21.15.7:0/2824792926 >> 172.21.15.7:0/2824792926 conn(0x7f46cc0fd760 msgr2=0x7f46cc0ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 -- 172.21.15.7:0/2824792926 shutdown_connections 2024-09-13T18:29:14.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.771+0000 7f46d1a00640 1 -- 172.21.15.7:0/2824792926 wait complete. 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.772+0000 7f46d1a00640 1 Processor -- start 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.772+0000 7f46d1a00640 1 -- start start 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46d1a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc102000 0x7f46cc198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46d1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc1031f0 0x7f46cc198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46d1a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc103bb0 0x7f46cc19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46d1a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc19fb40 con 0x7f46cc1031f0 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46d1a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc19fcb0 con 0x7f46cc103bb0 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46d1a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc19fe70 con 0x7f46cc102000 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc1031f0 0x7f46cc198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc102000 0x7f46cc198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc102000 0x7f46cc198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50206/0 (socket says 172.21.15.7:50206) 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46c3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc1031f0 0x7f46cc198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49074/0 (socket says 172.21.15.7:49074) 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 -- 172.21.15.7:0/114356326 learned_addr learned my addr 172.21.15.7:0/114356326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46cb400640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc103bb0 0x7f46cc19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 -- 172.21.15.7:0/114356326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc103bb0 msgr2=0x7f46cc19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc103bb0 0x7f46cc19f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 -- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc1031f0 msgr2=0x7f46cc198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc1031f0 0x7f46cc198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.773+0000 7f46caa00640 1 -- 172.21.15.7:0/114356326 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4009840 con 0x7f46cc102000 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.774+0000 7f46c3e00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc1031f0 0x7f46cc198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.774+0000 7f46caa00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc102000 0x7f46cc198050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46bc031500 tx=0x7f46bc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.774+0000 7f46c3400640 1 -- 172.21.15.7:0/114356326 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc005d50 con 0x7f46cc102000 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.774+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc009560 con 0x7f46cc102000 2024-09-13T18:29:14.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.774+0000 7f46c3400640 1 -- 172.21.15.7:0/114356326 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46bc003e00 con 0x7f46cc102000 2024-09-13T18:29:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.774+0000 7f46c3400640 1 -- 172.21.15.7:0/114356326 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc03bb50 con 0x7f46cc102000 2024-09-13T18:29:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.774+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc1a0460 con 0x7f46cc102000 2024-09-13T18:29:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.775+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc109550 con 0x7f46cc102000 2024-09-13T18:29:14.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.777+0000 7f46c3400640 1 -- 172.21.15.7:0/114356326 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f46bc03bcb0 con 0x7f46cc102000 2024-09-13T18:29:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.778+0000 7f46c3400640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46b00a1110 0x7f46b00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.779+0000 7f46c3400640 1 -- 172.21.15.7:0/114356326 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f46bc0ed140 con 0x7f46cc102000 2024-09-13T18:29:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.779+0000 7f46c3e00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46b00a1110 0x7f46b00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.779+0000 7f46c3e00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46b00a1110 0x7f46b00a35d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46cc199560 tx=0x7f46b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.781+0000 7f46c3400640 1 -- 172.21.15.7:0/114356326 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f46bc0b6880 con 0x7f46cc102000 2024-09-13T18:29:14.790 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:14 smithi007 ceph-mon[30588]: pgmap v710: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-13T18:29:14.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:14 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/4070291787' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:29:14.960 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:14 smithi116 ceph-mon[35109]: pgmap v710: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-13T18:29:14.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:14 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/4070291787' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:29:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:14 smithi067 ceph-mon[35103]: pgmap v710: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-13T18:29:14.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:14 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/4070291787' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:29:15.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.998+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46cc10d920 con 0x7f46cc102000 2024-09-13T18:29:15.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:14.999+0000 7f46c3400640 1 -- 172.21.15.7:0/114356326 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10889 (secure 0 0 0) 0x7f46bc03f090 con 0x7f46cc102000 2024-09-13T18:29:15.002 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:29:15.002 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/903446377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":903446377},{"type":"v1","addr":"172.21.15.7:6837","nonce":903446377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/3960338026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":3960338026},{"type":"v1","addr":"172.21.15.7:6839","nonce":3960338026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:15:06.002659+0000","modified":"2024-09-13T18:17:16.238743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24581,"mds_1":24559,"mds_2":24538,"mds_3":24533,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4101588502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4101588502},{"type":"v1","addr":"172.21.15.7:6841","nonce":4101588502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6833/344470719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":344470719},{"type":"v1","addr":"172.21.15.67:6833","nonce":344470719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6833/3628414330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3628414330},{"type":"v1","addr":"172.21.15.116:6833","nonce":3628414330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6835/379477361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":379477361},{"type":"v1","addr":"172.21.15.7:6835","nonce":379477361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24503":{"gid":24503,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.67:6835/833350667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":833350667},{"type":"v1","addr":"172.21.15.67:6835","nonce":833350667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.116:6835/4071332946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":4071332946},{"type":"v1","addr":"172.21.15.116:6835","nonce":4071332946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.67:6837/2829823752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2829823752},{"type":"v1","addr":"172.21.15.67:6837","nonce":2829823752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6837/1196913954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1196913954},{"type":"v1","addr":"172.21.15.116:6837","nonce":1196913954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/284751360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":284751360},{"type":"v1","addr":"172.21.15.116:6839","nonce":284751360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6839/2314229455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":2314229455},{"type":"v1","addr":"172.21.15.67:6839","nonce":2314229455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:29:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46b00a1110 msgr2=0x7f46b00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46b00a1110 0x7f46b00a35d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46cc199560 tx=0x7f46b4005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc102000 msgr2=0x7f46cc198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc102000 0x7f46cc198050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46bc031500 tx=0x7f46bc003c10 comp rx=0 tx=0).stop 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 shutdown_connections 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f46b00a1110 0x7f46b00a35d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc103bb0 0x7f46cc19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46cc1031f0 0x7f46cc198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 --2- 172.21.15.7:0/114356326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46cc102000 0x7f46cc198050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 >> 172.21.15.7:0/114356326 conn(0x7f46cc0fd760 msgr2=0x7f46cc106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 shutdown_connections 2024-09-13T18:29:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.001+0000 7f46d1a00640 1 -- 172.21.15.7:0/114356326 wait complete. 2024-09-13T18:29:15.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 -- 172.21.15.7:0/1897005349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 msgr2=0x7f17f8103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 --2- 172.21.15.7:0/1897005349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 0x7f17f8103470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009900 tx=0x7f17e402a410 comp rx=0 tx=0).stop 2024-09-13T18:29:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 -- 172.21.15.7:0/1897005349 shutdown_connections 2024-09-13T18:29:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 --2- 172.21.15.7:0/1897005349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17f81039b0 0x7f17f810a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 --2- 172.21.15.7:0/1897005349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 0x7f17f8103470 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 --2- 172.21.15.7:0/1897005349 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 0x7f17f8102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 -- 172.21.15.7:0/1897005349 >> 172.21.15.7:0/1897005349 conn(0x7f17f80fd580 msgr2=0x7f17f80ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 -- 172.21.15.7:0/1897005349 shutdown_connections 2024-09-13T18:29:15.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.177+0000 7f17fcc00640 1 -- 172.21.15.7:0/1897005349 wait complete. 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 Processor -- start 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 -- start start 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 0x7f17f8197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 0x7f17f8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17f81039b0 0x7f17f819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f819f940 con 0x7f17f81039b0 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f819fab0 con 0x7f17f8102ff0 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.178+0000 7f17fcc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f819fc70 con 0x7f17f8101e00 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17f81039b0 0x7f17f819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 0x7f17f8197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 0x7f17f8197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.7:50226/0 (socket says 172.21.15.7:50226) 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 -- 172.21.15.7:0/244764325 learned_addr learned my addr 172.21.15.7:0/244764325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f6a00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 0x7f17f8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 -- 172.21.15.7:0/244764325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 msgr2=0x7f17f8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 0x7f17f8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 -- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17f81039b0 msgr2=0x7f17f819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17f81039b0 0x7f17f819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 -- 172.21.15.7:0/244764325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8009490 con 0x7f17f8101e00 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17f7400640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 0x7f17f8197e50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f17e800e9c0 tx=0x7f17e800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17efe00640 1 -- 172.21.15.7:0/244764325 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e800cde0 con 0x7f17f8101e00 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17efe00640 1 -- 172.21.15.7:0/244764325 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e80108f0 con 0x7f17f8101e00 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e4009560 con 0x7f17f8101e00 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.179+0000 7f17efe00640 1 -- 172.21.15.7:0/244764325 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80188c0 con 0x7f17f8101e00 2024-09-13T18:29:15.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.180+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f81a01e0 con 0x7f17f8101e00 2024-09-13T18:29:15.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.181+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f8109330 con 0x7f17f8101e00 2024-09-13T18:29:15.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.183+0000 7f17efe00640 1 -- 172.21.15.7:0/244764325 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f17e8010a60 con 0x7f17f8101e00 2024-09-13T18:29:15.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.184+0000 7f17efe00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17dc0a1090 0x7f17dc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.184+0000 7f17efe00640 1 -- 172.21.15.7:0/244764325 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17e8014070 con 0x7f17f8101e00 2024-09-13T18:29:15.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.184+0000 7f17f6a00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17dc0a1090 0x7f17dc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.185+0000 7f17f6a00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17dc0a1090 0x7f17dc0a3550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f17e4005ab0 tx=0x7f17e4005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.186+0000 7f17efe00640 1 -- 172.21.15.7:0/244764325 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f17e8075e20 con 0x7f17f8101e00 2024-09-13T18:29:15.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.367+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f802c410 con 0x7f17f8101e00 2024-09-13T18:29:15.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.369+0000 7f17efe00640 1 -- 172.21.15.7:0/244764325 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22422 (secure 0 0 0) 0x7f17e809a1f0 con 0x7f17f8101e00 2024-09-13T18:29:15.372 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T18:29:15.372 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"d9377e86-71fa-11ef-bceb-c7b262605968","created":"2024-09-13T18:07:06.965649+0000","modified":"2024-09-13T18:16:10.029936+0000","last_up_change":"2024-09-13T18:14:15.877738+0000","last_in_change":"2024-09-13T18:13:56.152032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:10:37.028462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:15:04.217247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:15:05.500183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af9e0446-69fd-4727-87e3-8843be69e76e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6803","nonce":1444921762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6805","nonce":1444921762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6809","nonce":1444921762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":1444921762},{"type":"v1","addr":"172.21.15.7:6807","nonce":1444921762}]},"public_addr":"172.21.15.7:6803/1444921762","cluster_addr":"172.21.15.7:6805/1444921762","heartbeat_back_addr":"172.21.15.7:6809/1444921762","heartbeat_front_addr":"172.21.15.7:6807/1444921762","state":["exists","up"]},{"osd":1,"uuid":"b4126006-2c69-4d91-bd88-868de39d0cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6801","nonce":1600577441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6803","nonce":1600577441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6807","nonce":1600577441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1600577441},{"type":"v1","addr":"172.21.15.67:6805","nonce":1600577441}]},"public_addr":"172.21.15.67:6801/1600577441","cluster_addr":"172.21.15.67:6803/1600577441","heartbeat_back_addr":"172.21.15.67:6807/1600577441","heartbeat_front_addr":"172.21.15.67:6805/1600577441","state":["exists","up"]},{"osd":2,"uuid":"53b66ec9-242b-4ec9-80b5-6abf872a748f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6801","nonce":3932152081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6803","nonce":3932152081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6807","nonce":3932152081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3932152081},{"type":"v1","addr":"172.21.15.116:6805","nonce":3932152081}]},"public_addr":"172.21.15.116:6801/3932152081","cluster_addr":"172.21.15.116:6803/3932152081","heartbeat_back_addr":"172.21.15.116:6807/3932152081","heartbeat_front_addr":"172.21.15.116:6805/3932152081","state":["exists","up"]},{"osd":3,"uuid":"de4ca10d-cfea-4ff0-b71d-dca462cca1e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6811","nonce":1622258084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6813","nonce":1622258084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6817","nonce":1622258084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":1622258084},{"type":"v1","addr":"172.21.15.7:6815","nonce":1622258084}]},"public_addr":"172.21.15.7:6811/1622258084","cluster_addr":"172.21.15.7:6813/1622258084","heartbeat_back_addr":"172.21.15.7:6817/1622258084","heartbeat_front_addr":"172.21.15.7:6815/1622258084","state":["exists","up"]},{"osd":4,"uuid":"9537f823-5479-4ebc-8d59-2b4680603d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6809","nonce":570234379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6811","nonce":570234379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6815","nonce":570234379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":570234379},{"type":"v1","addr":"172.21.15.67:6813","nonce":570234379}]},"public_addr":"172.21.15.67:6809/570234379","cluster_addr":"172.21.15.67:6811/570234379","heartbeat_back_addr":"172.21.15.67:6815/570234379","heartbeat_front_addr":"172.21.15.67:6813/570234379","state":["exists","up"]},{"osd":5,"uuid":"5ac8d45a-bdc2-4afb-800f-0137f53371d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6809","nonce":1272520856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6811","nonce":1272520856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6815","nonce":1272520856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":1272520856},{"type":"v1","addr":"172.21.15.116:6813","nonce":1272520856}]},"public_addr":"172.21.15.116:6809/1272520856","cluster_addr":"172.21.15.116:6811/1272520856","heartbeat_back_addr":"172.21.15.116:6815/1272520856","heartbeat_front_addr":"172.21.15.116:6813/1272520856","state":["exists","up"]},{"osd":6,"uuid":"d9b1e65f-df07-4b3a-a539-d046476a6924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6819","nonce":967037099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6821","nonce":967037099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6825","nonce":967037099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":967037099},{"type":"v1","addr":"172.21.15.7:6823","nonce":967037099}]},"public_addr":"172.21.15.7:6819/967037099","cluster_addr":"172.21.15.7:6821/967037099","heartbeat_back_addr":"172.21.15.7:6825/967037099","heartbeat_front_addr":"172.21.15.7:6823/967037099","state":["exists","up"]},{"osd":7,"uuid":"a3507f69-414b-44ad-ba04-76cc2a294486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6817","nonce":4066195090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6819","nonce":4066195090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6823","nonce":4066195090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4066195090},{"type":"v1","addr":"172.21.15.67:6821","nonce":4066195090}]},"public_addr":"172.21.15.67:6817/4066195090","cluster_addr":"172.21.15.67:6819/4066195090","heartbeat_back_addr":"172.21.15.67:6823/4066195090","heartbeat_front_addr":"172.21.15.67:6821/4066195090","state":["exists","up"]},{"osd":8,"uuid":"1d972ef6-53bc-46f7-830d-eee3d6b87547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6817","nonce":85007124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6819","nonce":85007124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6823","nonce":85007124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":85007124},{"type":"v1","addr":"172.21.15.116:6821","nonce":85007124}]},"public_addr":"172.21.15.116:6817/85007124","cluster_addr":"172.21.15.116:6819/85007124","heartbeat_back_addr":"172.21.15.116:6823/85007124","heartbeat_front_addr":"172.21.15.116:6821/85007124","state":["exists","up"]},{"osd":9,"uuid":"612f22e2-8306-4302-ae63-359543549743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6827","nonce":2537283667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6829","nonce":2537283667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6833","nonce":2537283667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":2537283667},{"type":"v1","addr":"172.21.15.7:6831","nonce":2537283667}]},"public_addr":"172.21.15.7:6827/2537283667","cluster_addr":"172.21.15.7:6829/2537283667","heartbeat_back_addr":"172.21.15.7:6833/2537283667","heartbeat_front_addr":"172.21.15.7:6831/2537283667","state":["exists","up"]},{"osd":10,"uuid":"44734350-17d9-43ed-9a32-6d52226d6a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6825","nonce":782995716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6827","nonce":782995716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6831","nonce":782995716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":782995716},{"type":"v1","addr":"172.21.15.67:6829","nonce":782995716}]},"public_addr":"172.21.15.67:6825/782995716","cluster_addr":"172.21.15.67:6827/782995716","heartbeat_back_addr":"172.21.15.67:6831/782995716","heartbeat_front_addr":"172.21.15.67:6829/782995716","state":["exists","up"]},{"osd":11,"uuid":"0e90836c-ffe2-434a-b93c-520c3ef9652b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6825","nonce":3892290282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6827","nonce":3892290282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6831","nonce":3892290282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3892290282},{"type":"v1","addr":"172.21.15.116:6829","nonce":3892290282}]},"public_addr":"172.21.15.116:6825/3892290282","cluster_addr":"172.21.15.116:6827/3892290282","heartbeat_back_addr":"172.21.15.116:6831/3892290282","heartbeat_front_addr":"172.21.15.116:6829/3892290282","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:09:48.196004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:10.675034+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:10:33.070328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:00.407584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:23.251155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:11:45.708689+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:12.800449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:36.604599+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:12:59.584050+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:26.546763+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:13:50.219970+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:14:13.642299+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1716014046":"2024-09-14T18:08:08.423245+0000","172.21.15.7:6800/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/1721886388":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2474200435":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/2450025711":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/3391098565":"2024-09-14T18:08:08.423245+0000","172.21.15.7:0/3768640508":"2024-09-14T18:07:40.349994+0000","172.21.15.7:0/3365645542":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6801/568921109":"2024-09-14T18:07:40.349994+0000","172.21.15.7:6800/568921109":"2024-09-14T18:07:40.349994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:15.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17dc0a1090 msgr2=0x7f17dc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17dc0a1090 0x7f17dc0a3550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f17e4005ab0 tx=0x7f17e4005780 comp rx=0 tx=0).stop 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 msgr2=0x7f17f8197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 0x7f17f8197e50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f17e800e9c0 tx=0x7f17e800ee80 comp rx=0 tx=0).stop 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 shutdown_connections 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f17dc0a1090 0x7f17dc0a3550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17f81039b0 0x7f17f819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17f8102ff0 0x7f17f8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 --2- 172.21.15.7:0/244764325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17f8101e00 0x7f17f8197e50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 >> 172.21.15.7:0/244764325 conn(0x7f17f80fd580 msgr2=0x7f17f8106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 shutdown_connections 2024-09-13T18:29:15.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.371+0000 7f17fcc00640 1 -- 172.21.15.7:0/244764325 wait complete. 2024-09-13T18:29:15.390 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:29:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.547+0000 7fa931a00640 1 -- 172.21.15.7:0/3303953006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 msgr2=0x7fa92c10a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.547+0000 7fa931a00640 1 --2- 172.21.15.7:0/3303953006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c10a3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa924009ca0 tx=0x7fa92402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.547+0000 7fa931a00640 1 -- 172.21.15.7:0/3303953006 shutdown_connections 2024-09-13T18:29:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.547+0000 7fa931a00640 1 --2- 172.21.15.7:0/3303953006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c10a3f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.547+0000 7fa931a00640 1 --2- 172.21.15.7:0/3303953006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa92c1031a0 0x7fa92c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.547+0000 7fa931a00640 1 --2- 172.21.15.7:0/3303953006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c101fb0 0x7fa92c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.547+0000 7fa931a00640 1 -- 172.21.15.7:0/3303953006 >> 172.21.15.7:0/3303953006 conn(0x7fa92c0fd770 msgr2=0x7fa92c0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.548+0000 7fa931a00640 1 -- 172.21.15.7:0/3303953006 shutdown_connections 2024-09-13T18:29:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.548+0000 7fa931a00640 1 -- 172.21.15.7:0/3303953006 wait complete. 2024-09-13T18:29:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.548+0000 7fa931a00640 1 Processor -- start 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa931a00640 1 -- start start 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa931a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa92c101fb0 0x7fa92c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa931a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c1031a0 0x7fa92c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa931a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa931a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c19fa20 con 0x7fa92c103b60 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa931a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c19fb90 con 0x7fa92c1031a0 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa931a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c19fd50 con 0x7fa92c101fb0 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa92b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa92b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c19f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49108/0 (socket says 172.21.15.7:49108) 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa92b400640 1 -- 172.21.15.7:0/971303719 learned_addr learned my addr 172.21.15.7:0/971303719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa92aa00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa92c101fb0 0x7fa92c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.549+0000 7fa923e00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c1031a0 0x7fa92c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa92b400640 1 -- 172.21.15.7:0/971303719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa92c101fb0 msgr2=0x7fa92c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa92b400640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa92c101fb0 0x7fa92c197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa92b400640 1 -- 172.21.15.7:0/971303719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c1031a0 msgr2=0x7fa92c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa92b400640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c1031a0 0x7fa92c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa92b400640 1 -- 172.21.15.7:0/971303719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009490 con 0x7fa92c103b60 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa92b400640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c19f4e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa92402ade0 tx=0x7fa924032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa923400640 1 -- 172.21.15.7:0/971303719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924003b70 con 0x7fa92c103b60 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa923400640 1 -- 172.21.15.7:0/971303719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa924040070 con 0x7fa92c103b60 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa924009900 con 0x7fa92c103b60 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa923400640 1 -- 172.21.15.7:0/971303719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240043c0 con 0x7fa92c103b60 2024-09-13T18:29:15.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.550+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c1a0310 con 0x7fa92c103b60 2024-09-13T18:29:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.551+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c1093e0 con 0x7fa92c103b60 2024-09-13T18:29:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.553+0000 7fa923400640 1 -- 172.21.15.7:0/971303719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fa924042030 con 0x7fa92c103b60 2024-09-13T18:29:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.555+0000 7fa923400640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa9100a1110 0x7fa9100a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.555+0000 7fa923400640 1 -- 172.21.15.7:0/971303719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa9240edde0 con 0x7fa92c103b60 2024-09-13T18:29:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.555+0000 7fa92aa00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa9100a1110 0x7fa9100a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.556+0000 7fa92aa00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa9100a1110 0x7fa9100a35d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa92c103000 tx=0x7fa91c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.559+0000 7fa923400640 1 -- 172.21.15.7:0/971303719 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa9240b7730 con 0x7fa92c103b60 2024-09-13T18:29:15.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.780+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa92c02c3e0 con 0x7fa92c103b60 2024-09-13T18:29:15.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/104587335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/114356326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/244764325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.789+0000 7fa923400640 1 -- 172.21.15.7:0/971303719 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa9240bad50 con 0x7fa92c103b60 2024-09-13T18:29:15.792 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:29:15.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa9100a1110 msgr2=0x7fa9100a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa9100a1110 0x7fa9100a35d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa92c103000 tx=0x7fa91c005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:15.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 msgr2=0x7fa92c19f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c19f4e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa92402ade0 tx=0x7fa924032f20 comp rx=0 tx=0).stop 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 shutdown_connections 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fa9100a1110 0x7fa9100a35d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa92c103b60 0x7fa92c19f4e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa92c1031a0 0x7fa92c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 --2- 172.21.15.7:0/971303719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa92c101fb0 0x7fa92c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 >> 172.21.15.7:0/971303719 conn(0x7fa92c0fd770 msgr2=0x7fa92c1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 shutdown_connections 2024-09-13T18:29:15.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.792+0000 7fa931a00640 1 -- 172.21.15.7:0/971303719 wait complete. 2024-09-13T18:29:15.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:29:15.828 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/104587335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.828 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/114356326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.828 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/244764325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.846 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/104587335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.846 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/114356326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.846 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/244764325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:29:15.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 -- 172.21.15.7:0/2381137575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 msgr2=0x7f183c105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 --2- 172.21.15.7:0/2381137575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 0x7f183c105320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1824009900 tx=0x7f182402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 -- 172.21.15.7:0/2381137575 shutdown_connections 2024-09-13T18:29:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 --2- 172.21.15.7:0/2381137575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c105860 0x7f183c107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 --2- 172.21.15.7:0/2381137575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 0x7f183c105320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 --2- 172.21.15.7:0/2381137575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c100600 0x7f183c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 -- 172.21.15.7:0/2381137575 >> 172.21.15.7:0/2381137575 conn(0x7f183c0fa1e0 msgr2=0x7f183c0fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 -- 172.21.15.7:0/2381137575 shutdown_connections 2024-09-13T18:29:15.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.984+0000 7f183be00640 1 -- 172.21.15.7:0/2381137575 wait complete. 2024-09-13T18:29:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 Processor -- start 2024-09-13T18:29:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 -- start start 2024-09-13T18:29:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c100600 0x7f183c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 0x7f183c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c105860 0x7f183c19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c19f910 con 0x7f183c100600 2024-09-13T18:29:15.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c19fa80 con 0x7f183c105860 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183be00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c19fc40 con 0x7f183c102f30 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c100600 0x7f183c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c100600 0x7f183c197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49164/0 (socket says 172.21.15.7:49164) 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.985+0000 7f183aa00640 1 -- 172.21.15.7:0/4278908152 learned_addr learned my addr 172.21.15.7:0/4278908152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183b400640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c105860 0x7f183c19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f1833e00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 0x7f183c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183aa00640 1 -- 172.21.15.7:0/4278908152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 msgr2=0x7f183c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183aa00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 0x7f183c198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183aa00640 1 -- 172.21.15.7:0/4278908152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c105860 msgr2=0x7f183c19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183aa00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c105860 0x7f183c19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183aa00640 1 -- 172.21.15.7:0/4278908152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009560 con 0x7f183c100600 2024-09-13T18:29:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183b400640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c105860 0x7f183c19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f183aa00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c100600 0x7f183c197e20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f182c00e9f0 tx=0x7f182c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.986+0000 7f1833400640 1 -- 172.21.15.7:0/4278908152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c009720 con 0x7f183c100600 2024-09-13T18:29:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.987+0000 7f1833400640 1 -- 172.21.15.7:0/4278908152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f182c00cd80 con 0x7f183c100600 2024-09-13T18:29:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.987+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c19ff20 con 0x7f183c100600 2024-09-13T18:29:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.987+0000 7f1833400640 1 -- 172.21.15.7:0/4278908152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c010430 con 0x7f183c100600 2024-09-13T18:29:15.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.987+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c1a0340 con 0x7f183c100600 2024-09-13T18:29:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.988+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c1073a0 con 0x7f183c100600 2024-09-13T18:29:15.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.989+0000 7f1833400640 1 -- 172.21.15.7:0/4278908152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f182c005020 con 0x7f183c100600 2024-09-13T18:29:15.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.991+0000 7f1833400640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18200a1110 0x7f18200a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.991+0000 7f1833400640 1 -- 172.21.15.7:0/4278908152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8641+0+0 (secure 0 0 0) 0x7f182c014070 con 0x7f183c100600 2024-09-13T18:29:15.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.991+0000 7f1833e00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18200a1110 0x7f18200a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.992+0000 7f1833e00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18200a1110 0x7f18200a35d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1824031500 tx=0x7f1824005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:15.994+0000 7f1833400640 1 -- 172.21.15.7:0/4278908152 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f182c096340 con 0x7f183c100600 2024-09-13T18:29:16.041 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a[30583]: 2024-09-13T18:29:15.781+0000 7f8c72400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:29:16.041 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a[71519]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.041 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a[71519]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.041 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-mds[71523]: -- 172.21.15.7:0/1232113030 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555b93594d00 con 0x555b93569000 2024-09-13T18:29:16.041 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a[71519]: starting mds.a at 2024-09-13T18:29:16.042 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j[70238]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.042 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j[70238]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.042 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-mds[70242]: -- 172.21.15.7:0/4024729516 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55694d920d00 con 0x55694d8f5000 2024-09-13T18:29:16.042 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:29:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j[70238]: starting mds.j at 2024-09-13T18:29:16.210 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l[65270]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.211 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l[65270]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.211 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-mds[65274]: -- 172.21.15.116:0/1933533264 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aed33b8d00 con 0x55aed338c800 2024-09-13T18:29:16.211 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l[65270]: starting mds.l at 2024-09-13T18:29:16.211 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c[65875]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.211 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c[65875]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.211 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c[65875]: starting mds.c at 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f[65574]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f[65574]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-mds[65578]: -- 172.21.15.116:0/1140050380 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f8ed292d00 con 0x55f8ed267000 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f[65574]: starting mds.f at 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i[66183]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i[66183]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-mds[66193]: -- 172.21.15.116:0/1157716258 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fe27320d00 con 0x55fe272f5400 2024-09-13T18:29:16.212 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:29:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i[66183]: starting mds.i at 2024-09-13T18:29:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.218+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f183c02c480 con 0x7f183c100600 2024-09-13T18:29:16.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e[64867]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e[64867]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mds[64871]: -- 172.21.15.67:0/1699276100 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5566c73fed00 con 0x5566c73d2800 2024-09-13T18:29:16.247 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e[64867]: starting mds.e at 2024-09-13T18:29:16.247 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k[64550]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.248 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k[64550]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.248 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mds[64554]: -- 172.21.15.67:0/2966491313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e34138d00 con 0x560e3410d000 2024-09-13T18:29:16.248 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k[64550]: starting mds.k at 2024-09-13T18:29:16.248 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h[65167]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.248 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h[65167]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.248 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mds[65171]: -- 172.21.15.67:0/184706093 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56509edbad00 con 0x56509ed8e800 2024-09-13T18:29:16.248 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h[65167]: starting mds.h at 2024-09-13T18:29:16.249 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: ignoring --setuser ceph since I am not root 2024-09-13T18:29:16.249 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: ignoring --setgroup ceph since I am not root 2024-09-13T18:29:16.249 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mds[65486]: -- 172.21.15.67:0/660024242 <== mon.2 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558c5ff37340 con 0x558c5ff04800 2024-09-13T18:29:16.249 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-mds[65486]: -- 172.21.15.67:0/660024242 <== mon.2 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558c5ff30d00 con 0x558c5ff04800 2024-09-13T18:29:16.249 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:29:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: starting mds.b at 2024-09-13T18:29:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: pgmap v711: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:29:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/971303719' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:29:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:29:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:29:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T18:29:16.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/971303719' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T18:29:16.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-13T18:29:16.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:16 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/4278908152' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:29:16.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.793+0000 7f1833400640 1 -- 172.21.15.7:0/4278908152 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f182c099960 con 0x7f183c100600 2024-09-13T18:29:16.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18200a1110 msgr2=0x7f18200a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18200a1110 0x7f18200a35d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1824031500 tx=0x7f1824005780 comp rx=0 tx=0).stop 2024-09-13T18:29:16.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c100600 msgr2=0x7f183c197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c100600 0x7f183c197e20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f182c00e9f0 tx=0x7f182c00edf0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 shutdown_connections 2024-09-13T18:29:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f18200a1110 0x7f18200a35d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f183c105860 0x7f183c19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183c102f30 0x7f183c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 --2- 172.21.15.7:0/4278908152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f183c100600 0x7f183c197e20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.797+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 >> 172.21.15.7:0/4278908152 conn(0x7f183c0fa1e0 msgr2=0x7f183c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:16.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.798+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 shutdown_connections 2024-09-13T18:29:16.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.798+0000 7f183be00640 1 -- 172.21.15.7:0/4278908152 wait complete. 2024-09-13T18:29:16.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: pgmap v711: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/971303719' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/971303719' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-13T18:29:16.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:16 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/4278908152' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:29:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 -- 172.21.15.7:0/2946425601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 msgr2=0x7fc87c10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 --2- 172.21.15.7:0/2946425601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c10a1f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc874009ca0 tx=0x7fc87402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 -- 172.21.15.7:0/2946425601 shutdown_connections 2024-09-13T18:29:16.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 --2- 172.21.15.7:0/2946425601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c10a1f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 --2- 172.21.15.7:0/2946425601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c102fa0 0x7fc87c103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 --2- 172.21.15.7:0/2946425601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87c101db0 0x7fc87c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 -- 172.21.15.7:0/2946425601 >> 172.21.15.7:0/2946425601 conn(0x7fc87c0fd530 msgr2=0x7fc87c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:16.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 -- 172.21.15.7:0/2946425601 shutdown_connections 2024-09-13T18:29:16.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.986+0000 7fc881800640 1 -- 172.21.15.7:0/2946425601 wait complete. 2024-09-13T18:29:16.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 Processor -- start 2024-09-13T18:29:16.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 -- start start 2024-09-13T18:29:16.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87c101db0 0x7fc87c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c102fa0 0x7fc87c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c19f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c19f820 con 0x7fc87c103960 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c19f990 con 0x7fc87c101db0 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc881800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c19fb50 con 0x7fc87c102fa0 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc880e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c19f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc880e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c19f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49178/0 (socket says 172.21.15.7:49178) 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc880e00640 1 -- 172.21.15.7:0/645283295 learned_addr learned my addr 172.21.15.7:0/645283295 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc873e00640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c102fa0 0x7fc87c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.987+0000 7fc87be00640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87c101db0 0x7fc87c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc880e00640 1 -- 172.21.15.7:0/645283295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c102fa0 msgr2=0x7fc87c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc880e00640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c102fa0 0x7fc87c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc880e00640 1 -- 172.21.15.7:0/645283295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87c101db0 msgr2=0x7fc87c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc880e00640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87c101db0 0x7fc87c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc880e00640 1 -- 172.21.15.7:0/645283295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc874009900 con 0x7fc87c103960 2024-09-13T18:29:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc880e00640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c19f2b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc8740098d0 tx=0x7fc874032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc879600640 1 -- 172.21.15.7:0/645283295 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874003b70 con 0x7fc87c103960 2024-09-13T18:29:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc879600640 1 -- 172.21.15.7:0/645283295 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc874040070 con 0x7fc87c103960 2024-09-13T18:29:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c19fdd0 con 0x7fc87c103960 2024-09-13T18:29:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.988+0000 7fc879600640 1 -- 172.21.15.7:0/645283295 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740044a0 con 0x7fc87c103960 2024-09-13T18:29:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.989+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c1a01d0 con 0x7fc87c103960 2024-09-13T18:29:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.989+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c109260 con 0x7fc87c103960 2024-09-13T18:29:16.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.991+0000 7fc879600640 1 -- 172.21.15.7:0/645283295 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7fc874042030 con 0x7fc87c103960 2024-09-13T18:29:16.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.993+0000 7fc879600640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8600a1090 0x7fc8600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.993+0000 7fc879600640 1 -- 172.21.15.7:0/645283295 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8641+0+0 (secure 0 0 0) 0x7fc8740edfe0 con 0x7fc87c103960 2024-09-13T18:29:16.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.993+0000 7fc87be00640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8600a1090 0x7fc8600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.994+0000 7fc87be00640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8600a1090 0x7fc8600a3550 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc87c199210 tx=0x7fc86c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: pgmap v711: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/971303719' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/971303719' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-13T18:29:16.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:16 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/4278908152' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:29:16.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:16.997+0000 7fc879600640 1 -- 172.21.15.7:0/645283295 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc8740b75d0 con 0x7fc87c103960 2024-09-13T18:29:17.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.179+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc87c02c480 con 0x7fc87c103960 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: Cluster is now healthy 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6832/4185546388,v1:172.21.15.116:6834/4185546388] up:boot 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6833/353987194,v1:172.21.15.116:6835/353987194] up:boot 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6836/2868022342,v1:172.21.15.116:6838/2868022342] up:boot 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.116:6837/876868250,v1:172.21.15.116:6839/876868250] up:boot 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6832/1513416929,v1:172.21.15.67:6833/1513416929] up:boot 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6834/192804495,v1:172.21.15.67:6835/192804495] up:boot 2024-09-13T18:29:17.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6836/2273959503,v1:172.21.15.67:6837/2273959503] up:boot 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.67:6838/1024112105,v1:172.21.15.67:6839/1024112105] up:boot 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.7:6834/2949314529,v1:172.21.15.7:6835/2949314529] up:boot 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: mds.? [v2:172.21.15.7:6840/3680563334,v1:172.21.15.7:6841/3680563334] up:boot 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/4278908152' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: fsmap 12 up:standby 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:29:17.793 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:29:17.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:29:17.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:29:17.794 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:17 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/645283295' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:29:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.795+0000 7fc879600640 1 -- 172.21.15.7:0/645283295 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc8740babf0 con 0x7fc87c103960 2024-09-13T18:29:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:29:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8600a1090 msgr2=0x7fc8600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8600a1090 0x7fc8600a3550 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc87c199210 tx=0x7fc86c005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 msgr2=0x7fc87c19f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c19f2b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc8740098d0 tx=0x7fc874032f20 comp rx=0 tx=0).stop 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 shutdown_connections 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7fc8600a1090 0x7fc8600a3550 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc87c103960 0x7fc87c19f2b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc87c102fa0 0x7fc87c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 --2- 172.21.15.7:0/645283295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc87c101db0 0x7fc87c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 >> 172.21.15.7:0/645283295 conn(0x7fc87c0fd530 msgr2=0x7fc87c106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 shutdown_connections 2024-09-13T18:29:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.798+0000 7fc881800640 1 -- 172.21.15.7:0/645283295 wait complete. 2024-09-13T18:29:17.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:29:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:29:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:29:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: Cluster is now healthy 2024-09-13T18:29:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6832/4185546388,v1:172.21.15.116:6834/4185546388] up:boot 2024-09-13T18:29:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6833/353987194,v1:172.21.15.116:6835/353987194] up:boot 2024-09-13T18:29:17.961 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6836/2868022342,v1:172.21.15.116:6838/2868022342] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.116:6837/876868250,v1:172.21.15.116:6839/876868250] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6832/1513416929,v1:172.21.15.67:6833/1513416929] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6834/192804495,v1:172.21.15.67:6835/192804495] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6836/2273959503,v1:172.21.15.67:6837/2273959503] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.67:6838/1024112105,v1:172.21.15.67:6839/1024112105] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.7:6834/2949314529,v1:172.21.15.7:6835/2949314529] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: mds.? [v2:172.21.15.7:6840/3680563334,v1:172.21.15.7:6841/3680563334] up:boot 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/4278908152' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: fsmap 12 up:standby 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:29:17.962 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:29:17.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:29:17.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:29:17.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:29:17.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:29:17.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:29:17.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:29:17.963 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:17 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/645283295' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 -- 172.21.15.7:0/2085064557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4101940 msgr2=0x7f4dc41081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 --2- 172.21.15.7:0/2085064557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4101940 0x7f4dc41081d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009ca0 tx=0x7f4dbc02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 -- 172.21.15.7:0/2085064557 shutdown_connections 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 --2- 172.21.15.7:0/2085064557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc4101940 0x7f4dc41081d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 --2- 172.21.15.7:0/2085064557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dc4100f80 0x7f4dc4101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 --2- 172.21.15.7:0/2085064557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4dc40ffd90 0x7f4dc4100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 -- 172.21.15.7:0/2085064557 >> 172.21.15.7:0/2085064557 conn(0x7f4dc40fb510 msgr2=0x7f4dc40fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:17.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.984+0000 7f4dca800640 1 -- 172.21.15.7:0/2085064557 shutdown_connections 2024-09-13T18:29:17.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.985+0000 7f4dca800640 1 -- 172.21.15.7:0/2085064557 wait complete. 2024-09-13T18:29:17.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.985+0000 7f4dca800640 1 Processor -- start 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.985+0000 7f4dca800640 1 -- start start 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dca800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc40ffd90 0x7f4dc4074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dca800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4dc4100f80 0x7f4dc40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dca800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dc4101940 0x7f4dc4072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dca800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4073540 con 0x7f4dc40ffd90 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dca800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40736b0 con 0x7f4dc4101940 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dca800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc419fda0 con 0x7f4dc4100f80 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc40ffd90 0x7f4dc4074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc40ffd90 0x7f4dc4074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49198/0 (socket says 172.21.15.7:49198) 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 -- 172.21.15.7:0/3985294348 learned_addr learned my addr 172.21.15.7:0/3985294348 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T18:29:17.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc2a00640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4dc4100f80 0x7f4dc40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3e00640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dc4101940 0x7f4dc4072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 -- 172.21.15.7:0/3985294348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4dc4100f80 msgr2=0x7f4dc40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4dc4100f80 0x7f4dc40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 -- 172.21.15.7:0/3985294348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dc4101940 msgr2=0x7f4dc4072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dc4101940 0x7f4dc4072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3400640 1 -- 172.21.15.7:0/3985294348 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009900 con 0x7f4dc40ffd90 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.986+0000 7f4dc3e00640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dc4101940 0x7f4dc4072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.987+0000 7f4dc3400640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc40ffd90 0x7f4dc4074260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4db400e9f0 tx=0x7f4db400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.987+0000 7f4dbbe00640 1 -- 172.21.15.7:0/3985294348 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40096e0 con 0x7f4dc40ffd90 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.987+0000 7f4dbbe00640 1 -- 172.21.15.7:0/3985294348 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4db40044f0 con 0x7f4dc40ffd90 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.987+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc419fff0 con 0x7f4dc40ffd90 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.987+0000 7f4dbbe00640 1 -- 172.21.15.7:0/3985294348 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4010430 con 0x7f4dc40ffd90 2024-09-13T18:29:17.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.987+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc41a0470 con 0x7f4dc40ffd90 2024-09-13T18:29:17.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.988+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc41071d0 con 0x7f4dc40ffd90 2024-09-13T18:29:17.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.991+0000 7f4dbbe00640 1 -- 172.21.15.7:0/3985294348 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) v1 ==== 135872+0+0 (secure 0 0 0) 0x7f4db4003fa0 con 0x7f4dc40ffd90 2024-09-13T18:29:17.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.992+0000 7f4dbbe00640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4da80a1110 0x7f4da80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:17.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.993+0000 7f4dbbe00640 1 -- 172.21.15.7:0/3985294348 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8116+0+0 (secure 0 0 0) 0x7f4db4014070 con 0x7f4dc40ffd90 2024-09-13T18:29:17.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.993+0000 7f4dc2a00640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4da80a1110 0x7f4da80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:17.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.993+0000 7f4dc2a00640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4da80a1110 0x7f4da80a35d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4073fd0 tx=0x7f4db0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:29:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:29:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: Cluster is now healthy 2024-09-13T18:29:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6832/4185546388,v1:172.21.15.116:6834/4185546388] up:boot 2024-09-13T18:29:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6833/353987194,v1:172.21.15.116:6835/353987194] up:boot 2024-09-13T18:29:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6836/2868022342,v1:172.21.15.116:6838/2868022342] up:boot 2024-09-13T18:29:17.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.116:6837/876868250,v1:172.21.15.116:6839/876868250] up:boot 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6832/1513416929,v1:172.21.15.67:6833/1513416929] up:boot 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6834/192804495,v1:172.21.15.67:6835/192804495] up:boot 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6836/2273959503,v1:172.21.15.67:6837/2273959503] up:boot 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.67:6838/1024112105,v1:172.21.15.67:6839/1024112105] up:boot 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.7:6834/2949314529,v1:172.21.15.7:6835/2949314529] up:boot 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: mds.? [v2:172.21.15.7:6840/3680563334,v1:172.21.15.7:6841/3680563334] up:boot 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/4278908152' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: fsmap 12 up:standby 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:29:17.998 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:29:17.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:29:17.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:29:17.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:29:17.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='mgr.14150 172.21.15.7:0/992492170' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:29:17.999 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:17 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/645283295' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:29:17.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:17.995+0000 7f4dbbe00640 1 -- 172.21.15.7:0/3985294348 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4db4096440 con 0x7f4dc40ffd90 2024-09-13T18:29:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.182+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4dc410b6a0 con 0x7f4dc40ffd90 2024-09-13T18:29:18.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:18 smithi007 ceph-mon[30588]: pgmap v713: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-13T18:29:18.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:18 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/645283295' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T18:29:18.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:18 smithi007 ceph-mon[30588]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T18:29:18.792 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:18 smithi007 ceph-mon[30588]: from='client.? 172.21.15.7:0/3985294348' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:29:18.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.796+0000 7f4dbbe00640 1 -- 172.21.15.7:0/3985294348 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4db4099a60 con 0x7f4dc40ffd90 2024-09-13T18:29:18.799 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-09-13T18:29:18.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4da80a1110 msgr2=0x7f4da80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4da80a1110 0x7f4da80a35d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4073fd0 tx=0x7f4db0005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:18.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc40ffd90 msgr2=0x7f4dc4074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc40ffd90 0x7f4dc4074260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4db400e9f0 tx=0x7f4db400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 shutdown_connections 2024-09-13T18:29:18.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:6800/1436660417,v1:172.21.15.7:6801/1436660417] conn(0x7f4da80a1110 0x7f4da80a35d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4dc4101940 0x7f4dc4072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4dc4100f80 0x7f4dc40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 --2- 172.21.15.7:0/3985294348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4dc40ffd90 0x7f4dc4074260 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.800+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 >> 172.21.15.7:0/3985294348 conn(0x7f4dc40fb510 msgr2=0x7f4dc41043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:18.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.801+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 shutdown_connections 2024-09-13T18:29:18.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T18:29:18.801+0000 7f4dca800640 1 -- 172.21.15.7:0/3985294348 wait complete. 2024-09-13T18:29:18.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:29:18.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:29:18.912 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:18 smithi067 ceph-mon[35103]: pgmap v713: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-13T18:29:18.913 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:18 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/645283295' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T18:29:18.913 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:18 smithi067 ceph-mon[35103]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T18:29:18.913 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:18 smithi067 ceph-mon[35103]: from='client.? 172.21.15.7:0/3985294348' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:29:18.918 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:29:18.947 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:18 smithi116 ceph-mon[35109]: pgmap v713: 97 pgs: 97 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-13T18:29:18.947 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:18 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/645283295' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T18:29:18.947 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:18 smithi116 ceph-mon[35109]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T18:29:18.947 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:18 smithi116 ceph-mon[35109]: from='client.? 172.21.15.7:0/3985294348' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:29:18.951 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T18:29:18.952 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:29:18.987 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:29:19.005 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:29:19.023 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T18:29:19.023 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-13T18:29:19.023 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a 2024-09-13T18:29:19.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:19 smithi007 systemd[1]: Stopping Ceph mon.a for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:19.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a[30583]: 2024-09-13T18:29:19.444+0000 7f8c79200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:19.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a[30583]: 2024-09-13T18:29:19.444+0000 7f8c79200640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T18:29:19.791 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:19 smithi007 podman[86106]: 2024-09-13 18:29:19.506621598 +0000 UTC m=+0.193390620 container died 268cd935a6fd2889d5a3f2a34133aaf6ab3b40c97129c820b5cea5248c39a252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:29:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:19 smithi007 podman[86106]: 2024-09-13 18:29:19.958160516 +0000 UTC m=+0.644929525 container cleanup 268cd935a6fd2889d5a3f2a34133aaf6ab3b40c97129c820b5cea5248c39a252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:29:20.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:19 smithi007 bash[86106]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a 2024-09-13T18:29:20.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 13 18:29:20 smithi007 podman[86118]: 2024-09-13 18:29:20.201116889 +0000 UTC m=+0.681525871 container remove 268cd935a6fd2889d5a3f2a34133aaf6ab3b40c97129c820b5cea5248c39a252 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:29:20.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.a.service' 2024-09-13T18:29:20.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:20.689 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-13T18:29:20.689 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-13T18:29:20.689 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.b 2024-09-13T18:29:20.997 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:20 smithi067 systemd[1]: Stopping Ceph mon.b for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:21.416 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-b[35099]: 2024-09-13T18:29:21.038+0000 7fe1ff6da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:21.416 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-b[35099]: 2024-09-13T18:29:21.038+0000 7fe1ff6da640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-13T18:29:21.416 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:21 smithi067 podman[70489]: 2024-09-13 18:29:21.140441482 +0000 UTC m=+0.254788066 container died 4ecc450492ff258ec6ca2c677fd36a92021fbe84cdceccf109579420223e1d47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:29:21.741 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:21 smithi067 podman[70489]: 2024-09-13 18:29:21.51319915 +0000 UTC m=+0.627545736 container cleanup 4ecc450492ff258ec6ca2c677fd36a92021fbe84cdceccf109579420223e1d47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T18:29:21.741 INFO:journalctl@ceph.mon.b.smithi067.stdout:Sep 13 18:29:21 smithi067 bash[70489]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-b 2024-09-13T18:29:21.905 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.b.service' 2024-09-13T18:29:21.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:21.955 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-13T18:29:21.955 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-13T18:29:21.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.c 2024-09-13T18:29:22.249 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:22 smithi116 systemd[1]: Stopping Ceph mon.c for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:22.565 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c[35105]: 2024-09-13T18:29:22.244+0000 7f840dcd5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:22.566 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c[35105]: 2024-09-13T18:29:22.244+0000 7f840dcd5640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T18:29:22.566 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:22 smithi116 podman[70562]: 2024-09-13 18:29:22.297704925 +0000 UTC m=+0.145120082 container died 53e5bb6fa532fd98743bbf1145edcd70a45e6461b22a0e4fc6fdef7e41fb4add (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:29:22.950 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:22 smithi116 podman[70562]: 2024-09-13 18:29:22.671359774 +0000 UTC m=+0.518774930 container cleanup 53e5bb6fa532fd98743bbf1145edcd70a45e6461b22a0e4fc6fdef7e41fb4add (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T18:29:22.950 INFO:journalctl@ceph.mon.c.smithi116.stdout:Sep 13 18:29:22 smithi116 bash[70562]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mon-c 2024-09-13T18:29:23.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mon.c.service' 2024-09-13T18:29:23.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:23.150 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-13T18:29:23.151 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-13T18:29:23.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.x 2024-09-13T18:29:23.541 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:29:23 smithi007 systemd[1]: Stopping Ceph mgr.x for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:23.976 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:29:23 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:29:23.599+0000 7fbbb5200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:23.976 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:29:23 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x[30809]: 2024-09-13T18:29:23.599+0000 7fbbb5200640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-13T18:29:23.976 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:29:23 smithi007 podman[86227]: 2024-09-13 18:29:23.682824834 +0000 UTC m=+0.240967890 container died 09f2ff7bc14d4b592524bd74c6f3278b8a408fc3dcc14d9cf0eb642647ebcb4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:29:24.291 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:29:24 smithi007 podman[86227]: 2024-09-13 18:29:24.129886835 +0000 UTC m=+0.688029888 container cleanup 09f2ff7bc14d4b592524bd74c6f3278b8a408fc3dcc14d9cf0eb642647ebcb4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T18:29:24.291 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:29:24 smithi007 bash[86227]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x 2024-09-13T18:29:24.596 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 13 18:29:24 smithi007 podman[86239]: 2024-09-13 18:29:24.323281089 +0000 UTC m=+0.632574462 container remove 09f2ff7bc14d4b592524bd74c6f3278b8a408fc3dcc14d9cf0eb642647ebcb4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-13T18:29:24.617 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-13T18:29:24.692 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:24.692 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-13T18:29:24.692 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-13T18:29:24.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.y 2024-09-13T18:29:24.997 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:29:24 smithi067 systemd[1]: Stopping Ceph mgr.y for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:25.295 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:29:25 smithi067 podman[70611]: 2024-09-13 18:29:25.005367815 +0000 UTC m=+0.115664618 container died 92d147beb16d7de3cecac056aab78f38d3cab49e0312a4435c953a4c2c495c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:29:25.629 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:29:25 smithi067 podman[70611]: 2024-09-13 18:29:25.368094164 +0000 UTC m=+0.478390966 container cleanup 92d147beb16d7de3cecac056aab78f38d3cab49e0312a4435c953a4c2c495c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T18:29:25.629 INFO:journalctl@ceph.mgr.y.smithi067.stdout:Sep 13 18:29:25 smithi067 bash[70611]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-y 2024-09-13T18:29:25.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-13T18:29:25.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:25.842 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-13T18:29:25.842 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-13T18:29:25.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.z 2024-09-13T18:29:26.174 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:29:25 smithi116 systemd[1]: Stopping Ceph mgr.z for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:26.432 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:29:26 smithi116 podman[70684]: 2024-09-13 18:29:26.172105437 +0000 UTC m=+0.136049793 container died 1b6276b2a3447eaa45ba1e081b15e563b5e10033779548aedc02d7baae65576c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T18:29:26.712 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:29:26 smithi116 podman[70684]: 2024-09-13 18:29:26.567770433 +0000 UTC m=+0.531714785 container cleanup 1b6276b2a3447eaa45ba1e081b15e563b5e10033779548aedc02d7baae65576c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, ceph=True) 2024-09-13T18:29:26.712 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Sep 13 18:29:26 smithi116 bash[70684]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mgr-z 2024-09-13T18:29:27.018 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-13T18:29:27.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:27.054 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-13T18:29:27.055 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T18:29:27.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.0 2024-09-13T18:29:27.464 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:27 smithi007 systemd[1]: Stopping Ceph osd.0 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:27.791 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0[45179]: 2024-09-13T18:29:27.462+0000 7f6780200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:27.791 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0[45179]: 2024-09-13T18:29:27.462+0000 7f6780200640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-13T18:29:27.791 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0[45179]: 2024-09-13T18:29:27.462+0000 7f6780200640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:29:33.129 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:32 smithi007 podman[86350]: 2024-09-13 18:29:32.853085328 +0000 UTC m=+5.504552526 container died 24ad7daa27eb4539ff92ee60367e07ceb4ec4e4264310870d6404ad65e594637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T18:29:33.479 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:33 smithi007 podman[86350]: 2024-09-13 18:29:33.292257386 +0000 UTC m=+5.943724584 container cleanup 24ad7daa27eb4539ff92ee60367e07ceb4ec4e4264310870d6404ad65e594637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T18:29:33.480 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:33 smithi007 bash[86350]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0 2024-09-13T18:29:33.791 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:33 smithi007 podman[86369]: 2024-09-13 18:29:33.477125836 +0000 UTC m=+0.610426379 container remove 24ad7daa27eb4539ff92ee60367e07ceb4ec4e4264310870d6404ad65e594637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:29:34.170 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:34 smithi007 podman[86458]: 2024-09-13 18:29:33.927983931 +0000 UTC m=+0.027070599 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:29:34.170 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:34 smithi007 podman[86458]: 2024-09-13 18:29:34.039847939 +0000 UTC m=+0.138934587 container create 65862d9607dfe095866da1410beffb947bb8d9c7de79e999b9bdcb179b303b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T18:29:34.535 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:34 smithi007 podman[86458]: 2024-09-13 18:29:34.264071739 +0000 UTC m=+0.363158408 container init 65862d9607dfe095866da1410beffb947bb8d9c7de79e999b9bdcb179b303b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T18:29:34.535 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:34 smithi007 podman[86458]: 2024-09-13 18:29:34.271097152 +0000 UTC m=+0.370183791 container start 65862d9607dfe095866da1410beffb947bb8d9c7de79e999b9bdcb179b303b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T18:29:34.535 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:34 smithi007 podman[86458]: 2024-09-13 18:29:34.372735486 +0000 UTC m=+0.471822135 container attach 65862d9607dfe095866da1410beffb947bb8d9c7de79e999b9bdcb179b303b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T18:29:34.791 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 13 18:29:34 smithi007 podman[86458]: 2024-09-13 18:29:34.533926901 +0000 UTC m=+0.633013541 container died 65862d9607dfe095866da1410beffb947bb8d9c7de79e999b9bdcb179b303b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:29:35.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T18:29:35.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:35.336 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T18:29:35.336 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T18:29:35.337 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.1 2024-09-13T18:29:35.648 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:35 smithi067 systemd[1]: Stopping Ceph osd.1 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:35.997 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1[39611]: 2024-09-13T18:29:35.655+0000 7f9dec269640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:35.997 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1[39611]: 2024-09-13T18:29:35.655+0000 7f9dec269640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-13T18:29:35.997 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1[39611]: 2024-09-13T18:29:35.655+0000 7f9dec269640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:29:41.375 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:41 smithi067 podman[70744]: 2024-09-13 18:29:41.092032696 +0000 UTC m=+5.551782929 container died c67976e0faff5c0713843573e61f22f973270cb6d9c717404c834657b751a77d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:29:41.747 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:41 smithi067 podman[70744]: 2024-09-13 18:29:41.589133048 +0000 UTC m=+6.048883284 container cleanup c67976e0faff5c0713843573e61f22f973270cb6d9c717404c834657b751a77d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2) 2024-09-13T18:29:41.747 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:41 smithi067 bash[70744]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1 2024-09-13T18:29:42.135 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:41 smithi067 podman[70759]: 2024-09-13 18:29:41.823941398 +0000 UTC m=+0.732017034 container remove c67976e0faff5c0713843573e61f22f973270cb6d9c717404c834657b751a77d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T18:29:42.437 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:42 smithi067 podman[70848]: 2024-09-13 18:29:42.133414182 +0000 UTC m=+0.110740360 container create c2e07a9a809f63dcecbbc905a78b612c9a2c769bbf81ac25d5d9b9a4945b9a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T18:29:42.438 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:42 smithi067 podman[70848]: 2024-09-13 18:29:42.038495504 +0000 UTC m=+0.015821650 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:29:42.438 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:42 smithi067 podman[70848]: 2024-09-13 18:29:42.360817268 +0000 UTC m=+0.338143416 container init c2e07a9a809f63dcecbbc905a78b612c9a2c769bbf81ac25d5d9b9a4945b9a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T18:29:42.438 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:42 smithi067 podman[70848]: 2024-09-13 18:29:42.364049419 +0000 UTC m=+0.341375557 container start c2e07a9a809f63dcecbbc905a78b612c9a2c769bbf81ac25d5d9b9a4945b9a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T18:29:42.438 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:42 smithi067 podman[70848]: 2024-09-13 18:29:42.435764888 +0000 UTC m=+0.413091022 container attach c2e07a9a809f63dcecbbc905a78b612c9a2c769bbf81ac25d5d9b9a4945b9a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T18:29:42.747 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:42 smithi067 podman[70848]: 2024-09-13 18:29:42.551251261 +0000 UTC m=+0.528577406 container died c2e07a9a809f63dcecbbc905a78b612c9a2c769bbf81ac25d5d9b9a4945b9a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:29:43.201 INFO:journalctl@ceph.osd.1.smithi067.stdout:Sep 13 18:29:43 smithi067 podman[70872]: 2024-09-13 18:29:43.189029273 +0000 UTC m=+0.629296199 container remove c2e07a9a809f63dcecbbc905a78b612c9a2c769bbf81ac25d5d9b9a4945b9a11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:29:43.208 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T18:29:43.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:43.249 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T18:29:43.249 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T18:29:43.250 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.2 2024-09-13T18:29:43.549 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:43 smithi116 systemd[1]: Stopping Ceph osd.2 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:43.960 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2[40155]: 2024-09-13T18:29:43.546+0000 7fa55381c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:43.961 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2[40155]: 2024-09-13T18:29:43.546+0000 7fa55381c640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-13T18:29:43.961 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2[40155]: 2024-09-13T18:29:43.546+0000 7fa55381c640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:29:49.308 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:49 smithi116 podman[70823]: 2024-09-13 18:29:49.017712579 +0000 UTC m=+5.574454852 container died 86548bc515e7a59d315d6341b531a1edb80f56faa769abae22e2ad1e09827f2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:29:49.649 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:49 smithi116 podman[70823]: 2024-09-13 18:29:49.404810437 +0000 UTC m=+5.961552720 container cleanup 86548bc515e7a59d315d6341b531a1edb80f56faa769abae22e2ad1e09827f2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T18:29:49.649 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:49 smithi116 bash[70823]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2 2024-09-13T18:29:49.960 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:49 smithi116 podman[70839]: 2024-09-13 18:29:49.647582488 +0000 UTC m=+0.627685565 container remove 86548bc515e7a59d315d6341b531a1edb80f56faa769abae22e2ad1e09827f2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T18:29:50.261 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:49 smithi116 podman[70927]: 2024-09-13 18:29:49.965028786 +0000 UTC m=+0.110710599 container create c0f3073d124dfe3d9f2e7ffc46319d0863c6aa5005ffdf9af984231f49274530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T18:29:50.261 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:49 smithi116 podman[70927]: 2024-09-13 18:29:49.86970246 +0000 UTC m=+0.015384276 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:29:50.261 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:50 smithi116 podman[70927]: 2024-09-13 18:29:50.176573376 +0000 UTC m=+0.322255190 container init c0f3073d124dfe3d9f2e7ffc46319d0863c6aa5005ffdf9af984231f49274530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T18:29:50.261 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:50 smithi116 podman[70927]: 2024-09-13 18:29:50.179842185 +0000 UTC m=+0.325523992 container start c0f3073d124dfe3d9f2e7ffc46319d0863c6aa5005ffdf9af984231f49274530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T18:29:50.261 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:50 smithi116 podman[70927]: 2024-09-13 18:29:50.25899127 +0000 UTC m=+0.404673098 container attach c0f3073d124dfe3d9f2e7ffc46319d0863c6aa5005ffdf9af984231f49274530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T18:29:50.664 INFO:journalctl@ceph.osd.2.smithi116.stdout:Sep 13 18:29:50 smithi116 podman[70927]: 2024-09-13 18:29:50.365302869 +0000 UTC m=+0.510984675 container died c0f3073d124dfe3d9f2e7ffc46319d0863c6aa5005ffdf9af984231f49274530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T18:29:51.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T18:29:51.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:51.043 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T18:29:51.043 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T18:29:51.043 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.3 2024-09-13T18:29:51.451 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:51 smithi007 systemd[1]: Stopping Ceph osd.3 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:51.791 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:51 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3[51654]: 2024-09-13T18:29:51.448+0000 7f76ec000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:51.791 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:51 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3[51654]: 2024-09-13T18:29:51.448+0000 7f76ec000640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-13T18:29:51.791 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:51 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3[51654]: 2024-09-13T18:29:51.448+0000 7f76ec000640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:29:53.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:29:53 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:29:53.238+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:29:54.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:29:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:29:53.788+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:29:54.540 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:29:54 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:29:54.269+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:29:55.041 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:54 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3[51654]: 2024-09-13T18:29:54.612+0000 7f76e3400640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:31.524930+0000 front 2024-09-13T18:29:31.525013+0000 (oldest deadline 2024-09-13T18:29:54.325836+0000) 2024-09-13T18:29:55.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:29:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:29:54.754+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:29:55.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:29:54 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:29:54.804+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:29:55.540 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:29:55 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:29:55.247+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:29:55.710 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:29:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:29:55.278+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:29:56.041 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:55 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3[51654]: 2024-09-13T18:29:55.565+0000 7f76e3400640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:31.524930+0000 front 2024-09-13T18:29:31.525013+0000 (oldest deadline 2024-09-13T18:29:54.325836+0000) 2024-09-13T18:29:56.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:29:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:29:55.739+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:29:56.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:29:55 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:29:55.835+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:29:56.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:29:56 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:29:56.253+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:29:56.710 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:29:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:29:56.315+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:29:57.115 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:56 smithi007 podman[86571]: 2024-09-13 18:29:56.82391734 +0000 UTC m=+5.485162200 container died b14d13794e74701493cf092d0dac79eecd256b5ac1553417d14b632cfaec177d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:29:57.115 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:29:56 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:29:56.878+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:29:57.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:29:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:29:56.765+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:29:57.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:29:56 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:29:56.814+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:29:57.507 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:29:57 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:29:57.234+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:29:57.507 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:57 smithi007 podman[86571]: 2024-09-13 18:29:57.220150547 +0000 UTC m=+5.881395406 container cleanup b14d13794e74701493cf092d0dac79eecd256b5ac1553417d14b632cfaec177d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T18:29:57.507 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:57 smithi007 bash[86571]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3 2024-09-13T18:29:57.710 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:29:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:29:57.297+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:29:57.790 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:57 smithi007 podman[86589]: 2024-09-13 18:29:57.504845642 +0000 UTC m=+0.659917695 container remove b14d13794e74701493cf092d0dac79eecd256b5ac1553417d14b632cfaec177d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T18:29:58.158 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:57 smithi007 podman[86676]: 2024-09-13 18:29:57.895753871 +0000 UTC m=+0.027385556 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:29:58.158 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:58 smithi007 podman[86676]: 2024-09-13 18:29:58.014316046 +0000 UTC m=+0.145947767 container create b26c932f1c54962d1390d7d34d3113742f702ce4c38e7cb6482c7126e63f3ede (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:29:58.158 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:29:57 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:29:57.891+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:29:58.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:29:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:29:57.804+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:29:58.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:29:57 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:29:57.798+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:29:58.523 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:29:58 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:29:58.257+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:29:58.523 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:58 smithi007 podman[86676]: 2024-09-13 18:29:58.250077579 +0000 UTC m=+0.381709264 container init b26c932f1c54962d1390d7d34d3113742f702ce4c38e7cb6482c7126e63f3ede (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T18:29:58.523 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:58 smithi007 podman[86676]: 2024-09-13 18:29:58.257215228 +0000 UTC m=+0.388846913 container start b26c932f1c54962d1390d7d34d3113742f702ce4c38e7cb6482c7126e63f3ede (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T18:29:58.523 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:58 smithi007 podman[86676]: 2024-09-13 18:29:58.350023334 +0000 UTC m=+0.481655029 container attach b26c932f1c54962d1390d7d34d3113742f702ce4c38e7cb6482c7126e63f3ede (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:29:58.710 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:29:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:29:58.342+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:29:58.791 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 13 18:29:58 smithi007 podman[86699]: 2024-09-13 18:29:58.56147103 +0000 UTC m=+0.026071948 container died b26c932f1c54962d1390d7d34d3113742f702ce4c38e7cb6482c7126e63f3ede (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T18:29:59.147 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:29:58 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:29:58.904+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:29:59.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T18:29:59.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:29:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:29:58.788+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:29:59.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:29:58 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:29:58.753+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:29:59.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:29:59.255 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T18:29:59.255 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T18:29:59.255 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.4 2024-09-13T18:29:59.485 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:29:59 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:29:59.235+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:29:59.552 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:29:59 smithi067 systemd[1]: Stopping Ceph osd.4 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:29:59.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:29:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:29:59.356+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:29:59.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:29:59 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:29:59.728+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:29:59.997 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:29:59 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:29:59.550+0000 7f0f28417640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:29:59.997 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:29:59 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:29:59.550+0000 7f0f28417640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-13T18:29:59.997 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:29:59 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:29:59.550+0000 7f0f28417640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:00.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:29:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:29:59.792+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:00.260 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:29:59 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:29:59.894+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:00.540 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:00 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:00.256+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:00.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:00 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:00.314+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:01.041 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:00 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:00.882+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:01.211 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:00 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:00.769+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:01.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:00 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:00.777+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:01.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:01 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:01.278+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:01.784 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:01 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:30:01.710+0000 7f0f21213640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.439546+0000 front 2024-09-13T18:29:40.439527+0000 (oldest deadline 2024-09-13T18:30:01.539653+0000) 2024-09-13T18:30:01.793 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:01 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:01.295+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:02.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:01 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:01.755+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:02.211 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:01 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:01.755+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:02.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:01 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:01.781+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:02.290 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:01 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:01.894+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:02.611 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:02 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:02.322+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:02.790 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:02.301+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:02.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:02.301+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:02.960 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:02 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:02.726+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:02.961 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:02 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:02.726+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:02.961 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:02 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:02.609+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:02.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:02 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:02.780+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:02.997 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:02 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:30:02.739+0000 7f0f21213640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.439546+0000 front 2024-09-13T18:29:40.439527+0000 (oldest deadline 2024-09-13T18:30:01.539653+0000) 2024-09-13T18:30:03.290 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:02.913+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:03.637 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:03 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:03.288+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:03.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:03.328+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:03.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:03.328+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:03.960 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:03 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:03.635+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:03.961 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:03 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:03.731+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:03.961 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:03 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:03.731+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:04.133 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:03 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:03.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:04.134 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:03 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:03.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:04.134 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:03 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4[46075]: 2024-09-13T18:30:03.769+0000 7f0f21213640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.439546+0000 front 2024-09-13T18:29:40.439527+0000 (oldest deadline 2024-09-13T18:30:01.539653+0000) 2024-09-13T18:30:04.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:03 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:03.956+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:04.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:04 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:04.131+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:04.657 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:04 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:04.252+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:04.657 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:04 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:04.252+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:04.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:04 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:04.311+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:04.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:04 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:04.311+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:04.960 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:04 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:04.654+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:04.961 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:04 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:04.723+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:04.961 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:04 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:04.723+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:05.135 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:04 smithi067 podman[70962]: 2024-09-13 18:30:04.942531617 +0000 UTC m=+5.491935534 container died 35fac61257ca9f3d57e93476daa648700b429d6d270fbeb7de7fd75f2548ecee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T18:30:05.135 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:04 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:04.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:05.135 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:04 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:04.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:05.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:04 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:04.915+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:05.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:05 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:05.132+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:05.497 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:05 smithi067 podman[70962]: 2024-09-13 18:30:05.325160694 +0000 UTC m=+5.874564616 container cleanup 35fac61257ca9f3d57e93476daa648700b429d6d270fbeb7de7fd75f2548ecee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T18:30:05.497 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:05 smithi067 bash[70962]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4 2024-09-13T18:30:05.701 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:05 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:05.275+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:05.701 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:05 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:05.275+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:05.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:05.303+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:05.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:05.303+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:05.887 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:05 smithi067 podman[70981]: 2024-09-13 18:30:05.593286968 +0000 UTC m=+0.643157011 container remove 35fac61257ca9f3d57e93476daa648700b429d6d270fbeb7de7fd75f2548ecee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T18:30:05.887 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:05 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:05.741+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:05.887 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:05 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:05.741+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:05.961 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:05 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:05.699+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:05.961 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:05 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:05.724+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:05.961 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:05 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:05.724+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:06.214 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:06 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:06.087+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:06.214 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:05 smithi067 podman[71068]: 2024-09-13 18:30:05.885467549 +0000 UTC m=+0.092955563 container create ccf13687f1a8ab9d2fa6a63c8fb34a7edcbaa5a19547aa46653799df9e0ac43c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T18:30:06.215 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:05 smithi067 podman[71068]: 2024-09-13 18:30:05.808590426 +0000 UTC m=+0.016078395 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:30:06.215 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:06 smithi067 podman[71068]: 2024-09-13 18:30:06.121168665 +0000 UTC m=+0.328656634 container init ccf13687f1a8ab9d2fa6a63c8fb34a7edcbaa5a19547aa46653799df9e0ac43c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T18:30:06.215 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:06 smithi067 podman[71068]: 2024-09-13 18:30:06.124414648 +0000 UTC m=+0.331902626 container start ccf13687f1a8ab9d2fa6a63c8fb34a7edcbaa5a19547aa46653799df9e0ac43c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T18:30:06.215 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:06 smithi067 podman[71068]: 2024-09-13 18:30:06.212694925 +0000 UTC m=+0.420182897 container attach ccf13687f1a8ab9d2fa6a63c8fb34a7edcbaa5a19547aa46653799df9e0ac43c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD) 2024-09-13T18:30:06.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:05.936+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:06.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:05.936+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:06.497 INFO:journalctl@ceph.osd.4.smithi067.stdout:Sep 13 18:30:06 smithi067 podman[71068]: 2024-09-13 18:30:06.309871821 +0000 UTC m=+0.517359789 container died ccf13687f1a8ab9d2fa6a63c8fb34a7edcbaa5a19547aa46653799df9e0ac43c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T18:30:06.710 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:06 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:06.236+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:06.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:06 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:06.236+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:06.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:06.311+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:06.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:06.311+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:06.859 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:06 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:06.787+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:06.859 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:06 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:06.787+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:06.878 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T18:30:06.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:30:06.917 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T18:30:06.917 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T18:30:06.917 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.5 2024-09-13T18:30:07.193 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:06 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:06.737+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:07.193 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:06 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:06.745+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:07.193 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:06 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:06.745+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:07.193 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:06 smithi116 systemd[1]: Stopping Ceph osd.5 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:30:07.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:07 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:07.080+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:07.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:06.983+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:07.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:06 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:06.983+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:07.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:07.189+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:07.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:07.189+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:07.461 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:07.198+0000 7f7c22bbd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:30:07.461 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:07.198+0000 7f7c22bbd640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-13T18:30:07.461 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:07.198+0000 7f7c22bbd640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:07.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:07.315+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:07.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:07 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:07.315+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:08.108 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:07 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:07.816+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:08.108 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:07 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:07.816+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:08.210 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:07.747+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:08.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:07.724+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:08.211 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:07 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:07.724+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:08.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:08 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:08.032+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:08.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:08 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:08.032+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:08.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:08 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:08.208+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:08.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:08 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:08.208+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:08.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:08 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:08.106+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:08.790 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:08 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:08.296+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:08.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:08 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:08.296+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:09.113 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:08 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:08.782+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:09.113 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:08 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:08.782+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:09.207 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:08 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:08.758+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:09.208 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:08 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:08.768+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:09.208 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:08 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:08.768+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:09.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:09 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:09.206+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:09.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:09 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:09.206+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:09.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:09 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:09.110+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:09.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:09 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:09.283+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:09.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:09 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:09.283+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:09.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:09 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:09.057+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:09.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:09 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:09.057+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:10.085 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:10 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:10.079+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:10.085 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:09 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:09.792+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:10.085 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:09 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:09.792+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:10.182 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:09 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:09.774+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:10.182 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:09 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:09.718+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:10.182 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:09 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:09.718+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:10.312 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:10.048+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:10.313 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:10.048+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:10.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:10 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:10.179+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:10.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:10 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:10.179+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:10.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:10.310+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:10.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:10 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:10.310+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:11.118 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:10 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:10.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:11.118 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:10 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:10.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:11.118 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:10 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:10.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:11.198 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:10 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:10.767+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:11.199 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:10 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:10.757+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:11.199 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:10 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:10.757+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:11.354 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:11.038+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:11.355 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:11.038+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:11.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:11 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:11.195+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:11.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:11 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:11.196+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:11.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:11.116+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:11.790 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:11.352+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:11.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:11 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:11.352+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:12.165 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:11 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:11.791+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:12.165 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:11 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:11.797+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.531597+0000 front 2024-09-13T18:29:28.531489+0000 (oldest deadline 2024-09-13T18:29:53.231275+0000) 2024-09-13T18:30:12.166 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:11 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:11.797+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:36.633153+0000 front 2024-09-13T18:29:36.633165+0000 (oldest deadline 2024-09-13T18:30:01.233729+0000) 2024-09-13T18:30:12.166 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:11 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5[47055]: 2024-09-13T18:30:11.797+0000 7f7c1b9b9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.635286+0000 front 2024-09-13T18:29:47.635263+0000 (oldest deadline 2024-09-13T18:30:11.735415+0000) 2024-09-13T18:30:12.167 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:11.790+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:12.167 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:11.790+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:12.167 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:11 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:11.790+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:12.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:12 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:12.033+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:12.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:12 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:12.033+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:12.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:12 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:12.163+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:12.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:12 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:12.163+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:12.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:12 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:12.164+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:12.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:12 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:12.164+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:12.790 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:12 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:12.345+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:12.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:12 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:12.345+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:12.883 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:12 smithi116 podman[71042]: 2024-09-13 18:30:12.549719349 +0000 UTC m=+5.440679079 container died 4c58609f1bb233296c04db84e17d8d5518c7ca2202fdb240104ab6a2be811c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T18:30:12.883 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:12 smithi116 podman[71042]: 2024-09-13 18:30:12.881038787 +0000 UTC m=+5.771998516 container cleanup 4c58609f1bb233296c04db84e17d8d5518c7ca2202fdb240104ab6a2be811c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T18:30:12.883 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:12 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:12.780+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:13.131 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:12 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:12.752+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:13.132 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:12 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:12.752+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:13.132 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:12 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:12.752+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:13.210 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:12 smithi116 bash[71042]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5 2024-09-13T18:30:13.211 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:13 smithi116 podman[71057]: 2024-09-13 18:30:13.049030057 +0000 UTC m=+0.497632554 container remove 4c58609f1bb233296c04db84e17d8d5518c7ca2202fdb240104ab6a2be811c00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T18:30:13.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:13 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:13.114+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:13.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:13 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:13.114+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:13.354 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:13.046+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:13.355 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:13.046+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:13.355 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:13.046+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:13.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:13 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:13.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:13.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:13 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:13.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:13.741 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:13 smithi116 podman[71144]: 2024-09-13 18:30:13.390314656 +0000 UTC m=+0.015525790 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:30:13.741 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:13 smithi116 podman[71144]: 2024-09-13 18:30:13.508222403 +0000 UTC m=+0.133433525 container create e8c94dd8f4fc67981f478ff15e582b4eaf916d4c3fd8a0c8c21ba3bbf627d3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T18:30:13.741 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:13 smithi116 podman[71144]: 2024-09-13 18:30:13.73557141 +0000 UTC m=+0.360782532 container init e8c94dd8f4fc67981f478ff15e582b4eaf916d4c3fd8a0c8c21ba3bbf627d3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T18:30:13.741 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:13 smithi116 podman[71144]: 2024-09-13 18:30:13.738956365 +0000 UTC m=+0.364167489 container start e8c94dd8f4fc67981f478ff15e582b4eaf916d4c3fd8a0c8c21ba3bbf627d3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T18:30:13.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:13.361+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:13.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:13.361+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:13.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:13.361+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:43.326352+0000 front 2024-09-13T18:29:43.326402+0000 (oldest deadline 2024-09-13T18:30:12.726811+0000) 2024-09-13T18:30:13.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:13 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:13.741+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:13.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:13 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:13.741+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:13.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:13 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:13.741+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:14.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:13 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:13.763+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:14.111 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:13 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:13.763+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:14.112 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:14 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:14.109+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:14.112 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:14 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:14.109+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:14.112 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:14 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:14.109+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:14.113 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:13 smithi116 podman[71144]: 2024-09-13 18:30:13.84412876 +0000 UTC m=+0.469339885 container attach e8c94dd8f4fc67981f478ff15e582b4eaf916d4c3fd8a0c8c21ba3bbf627d3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:30:14.113 INFO:journalctl@ceph.osd.5.smithi116.stdout:Sep 13 18:30:13 smithi116 podman[71144]: 2024-09-13 18:30:13.922946322 +0000 UTC m=+0.548157461 container died e8c94dd8f4fc67981f478ff15e582b4eaf916d4c3fd8a0c8c21ba3bbf627d3b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T18:30:14.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:14.008+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:14.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:14.008+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:14.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:14.008+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:14.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:14 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:14.092+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:14.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:14 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:14.092+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:14.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T18:30:14.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:30:14.569 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T18:30:14.569 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-13T18:30:14.570 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.6 2024-09-13T18:30:14.626 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:14.363+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:14.626 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:14.363+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:14.626 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:14.363+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:43.326352+0000 front 2024-09-13T18:29:43.326402+0000 (oldest deadline 2024-09-13T18:30:12.726811+0000) 2024-09-13T18:30:14.961 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:14 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:14.715+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:14.961 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:14 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:14.715+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:14.989 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:14 smithi007 systemd[1]: Stopping Ceph osd.6 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:30:14.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:14 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:14.740+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:14.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:14 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:14.740+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:14.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:14 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:14.740+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:15.291 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:14.983+0000 7f0c8f800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:30:15.291 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:14.983+0000 7f0c8f800640 -1 osd.6 91 *** Got signal Terminated *** 2024-09-13T18:30:15.291 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:14 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:14.983+0000 7f0c8f800640 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:15.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:15.057+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:15.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:15.057+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:15.292 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:15.057+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:15.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:15.120+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:15.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:15.120+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:15.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:15.120+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:15.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:15.111+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:15.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:15.111+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:15.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:15.373+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:15.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:15.373+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:15.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:15 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:15.373+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:43.326352+0000 front 2024-09-13T18:29:43.326402+0000 (oldest deadline 2024-09-13T18:30:12.726811+0000) 2024-09-13T18:30:15.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:15.727+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:15.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:15.727+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:15.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:15 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:15.727+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:16.153 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:15.750+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:16.154 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:15 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:15.750+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:16.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:16 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:16.151+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:16.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:16 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:16.151+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:16.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:16 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:16.151+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:16.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:16 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:16.112+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:16.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:16 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:16.112+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:16.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:16.338+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:16.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:16.338+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:16.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:16.338+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:43.326352+0000 front 2024-09-13T18:29:43.326402+0000 (oldest deadline 2024-09-13T18:30:12.726811+0000) 2024-09-13T18:30:16.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:16.097+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:16.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:16.097+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:16.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:16 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:16.097+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:16.960 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:16 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:16.706+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:16.961 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:16 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:16.706+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:16.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:16 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:16.695+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:16.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:16 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:16.695+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:16.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:16 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:16.695+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:17.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:17 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:17.116+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:17.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:17 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:17.116+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:17.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:17 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:17.116+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:17.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:17.117+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:17.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:17.117+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:17.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:17 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:17.356+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:17.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:17 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:17.356+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:17.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:17 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:17.356+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:43.326352+0000 front 2024-09-13T18:29:43.326402+0000 (oldest deadline 2024-09-13T18:30:12.726811+0000) 2024-09-13T18:30:17.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:17 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:17.146+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:17.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:17 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:17.146+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:17.542 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:17 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:17.146+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:17.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:17.692+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:17.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:17.692+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:17.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:17.692+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:17.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:17.692+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:18.138 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:17 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:17.716+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:18.138 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:17 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:17.716+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:18.464 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:18 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:18.136+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:18.465 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:18 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:18.136+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:18.465 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:18 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:18.136+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:18.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:18 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:18.151+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:18.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:18 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:18.151+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:18.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:18 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:18.394+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:18.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:18 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:18.395+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:18.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:18 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:18.395+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:43.326352+0000 front 2024-09-13T18:29:43.326402+0000 (oldest deadline 2024-09-13T18:30:12.726811+0000) 2024-09-13T18:30:18.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:18 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:18.181+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:18.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:18 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:18.181+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:18.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:18 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:18.181+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:18.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:18 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:18.181+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:18.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:18 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:18.685+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:18.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:18 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:18.685+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:18.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:18 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:18.685+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:18.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:18 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:18.685+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:19.112 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:18 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:18.726+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:19.112 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:18 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:18.726+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:19.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:19 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:19.110+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:19.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:19 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:19.110+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:19.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:19 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:19.110+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:19.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:19 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:19.105+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:19.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:19 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:19.105+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:19.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:19.353+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.023041+0000 front 2024-09-13T18:29:30.023055+0000 (oldest deadline 2024-09-13T18:29:52.923277+0000) 2024-09-13T18:30:19.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:19.353+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.324931+0000 front 2024-09-13T18:29:39.324998+0000 (oldest deadline 2024-09-13T18:30:01.625048+0000) 2024-09-13T18:30:19.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:19.353+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:43.326352+0000 front 2024-09-13T18:29:43.326402+0000 (oldest deadline 2024-09-13T18:30:12.726811+0000) 2024-09-13T18:30:19.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6[58144]: 2024-09-13T18:30:19.353+0000 7f0c86c00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:52.727248+0000 front 2024-09-13T18:29:52.727262+0000 (oldest deadline 2024-09-13T18:30:18.627352+0000) 2024-09-13T18:30:19.542 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:19.189+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:19.542 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:19.189+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:19.542 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:19.189+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:19.542 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:19 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:19.189+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:19.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:19 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:19.662+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:19.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:19 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:19.662+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:19.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:19 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:19.662+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:19.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:19 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:19.662+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:20.147 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:19 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:19.765+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:20.147 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:19 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:19.765+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:20.147 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:19 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:19.765+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:20.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:20.144+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:20.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:20.144+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:20.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:20.144+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:20.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:20 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:20.126+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:20.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:20 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:20.126+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:20.515 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:20 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:20.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:20.515 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:20 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:20.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:20.515 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:20 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:20.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:20.515 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:20 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:20.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:20.791 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:20 smithi007 podman[86792]: 2024-09-13 18:30:20.513080287 +0000 UTC m=+5.646326901 container died eb226e876e2d09897db6f418c7c1a4631af93ddbb4092ee34fc94b220ea1220f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:30:20.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:20 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:20.707+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:20.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:20 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:20.707+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:20.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:20 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:20.707+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:20.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:20 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:20.707+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:21.131 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:20.774+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:21.131 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:20.774+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:21.131 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:20 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:20.774+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:21.147 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:20 smithi007 podman[86792]: 2024-09-13 18:30:20.989131812 +0000 UTC m=+6.122378425 container cleanup eb226e876e2d09897db6f418c7c1a4631af93ddbb4092ee34fc94b220ea1220f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-13T18:30:21.147 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:20 smithi007 bash[86792]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6 2024-09-13T18:30:21.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:21.128+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:21.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:21.128+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:21.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:21.128+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:21.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:21.125+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:21.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:21.125+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:21.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:21 smithi007 podman[86812]: 2024-09-13 18:30:21.201094292 +0000 UTC m=+0.672712466 container remove eb226e876e2d09897db6f418c7c1a4631af93ddbb4092ee34fc94b220ea1220f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T18:30:21.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:21 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:21.144+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:21.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:21 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:21.144+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:21.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:21 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:21.144+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:21.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:21 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:21.144+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:21.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:21.720+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:21.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:21.720+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:21.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:21.720+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:21.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:21.720+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:22.041 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:21 smithi007 podman[86899]: 2024-09-13 18:30:21.660954151 +0000 UTC m=+0.027448043 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:30:22.041 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:21 smithi007 podman[86899]: 2024-09-13 18:30:21.760383833 +0000 UTC m=+0.126877711 container create 5c793ca3dca5a278276191ed24da0b84cdbbee739fd857b60e67a3cb4583cbb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True) 2024-09-13T18:30:22.041 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:21 smithi007 podman[86899]: 2024-09-13 18:30:21.979452893 +0000 UTC m=+0.345946772 container init 5c793ca3dca5a278276191ed24da0b84cdbbee739fd857b60e67a3cb4583cbb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:30:22.041 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:21 smithi007 podman[86899]: 2024-09-13 18:30:21.986329495 +0000 UTC m=+0.352823383 container start 5c793ca3dca5a278276191ed24da0b84cdbbee739fd857b60e67a3cb4583cbb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T18:30:22.103 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:21.810+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:22.103 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:21.810+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:22.103 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:21 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:21.810+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:22.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:22.099+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:22.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:22.099+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:22.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:22.099+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:22.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:22.089+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:22.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:22.089+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:22.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:22.089+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:55.878559+0000 front 2024-09-13T18:29:55.878572+0000 (oldest deadline 2024-09-13T18:30:21.778423+0000) 2024-09-13T18:30:22.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:22 smithi007 podman[86899]: 2024-09-13 18:30:22.079071477 +0000 UTC m=+0.445565391 container attach 5c793ca3dca5a278276191ed24da0b84cdbbee739fd857b60e67a3cb4583cbb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T18:30:22.541 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 13 18:30:22 smithi007 podman[86899]: 2024-09-13 18:30:22.246835419 +0000 UTC m=+0.613329298 container died 5c793ca3dca5a278276191ed24da0b84cdbbee739fd857b60e67a3cb4583cbb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731) 2024-09-13T18:30:22.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:22 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:22.103+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:22.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:22 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:22.103+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:22.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:22 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:22.103+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:22.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:22 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:22.103+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:22.871 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.6.service' 2024-09-13T18:30:22.945 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:30:22.946 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-13T18:30:22.946 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-13T18:30:22.946 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.7 2024-09-13T18:30:22.972 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:22.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:22.972 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:22.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:22.972 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:22.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:22.972 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:22 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:22.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:23.129 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:22.847+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:23.129 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:22.847+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:23.129 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:22 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:22.847+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:23.237 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:22 smithi067 systemd[1]: Stopping Ceph osd.7 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:30:23.238 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:23.085+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:23.238 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:23.085+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:23.238 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:23.085+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:55.878559+0000 front 2024-09-13T18:29:55.878572+0000 (oldest deadline 2024-09-13T18:30:21.778423+0000) 2024-09-13T18:30:23.238 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:23.235+0000 7f6f4d7bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:30:23.238 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:23.235+0000 7f6f4d7bd640 -1 osd.7 91 *** Got signal Terminated *** 2024-09-13T18:30:23.238 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:23.235+0000 7f6f4d7bd640 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:23.290 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:23 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:23.068+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:23.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:23 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:23.068+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:23.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:23 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:23.068+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:23.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:23 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:23.068+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:23.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:23.126+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:23.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:23.126+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:23.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:23.126+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:23.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:23.701+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:23.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:23.701+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:23.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:23.701+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:23.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:23 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:23.701+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:24.143 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:23.877+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:24.143 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:23.877+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:24.143 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:23 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:23.877+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:24.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:24.140+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:24.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:24.140+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:24.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:24.140+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:24.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:24.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:24.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:24.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:24.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:24.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:55.878559+0000 front 2024-09-13T18:29:55.878572+0000 (oldest deadline 2024-09-13T18:30:21.778423+0000) 2024-09-13T18:30:24.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:24.102+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:24.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:24.102+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:24.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:24.102+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:24.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:24 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:24.102+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:24.769 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:24.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:24.769 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:24.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:24.769 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:24.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:24.769 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:24 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:24.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:25.169 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:24.895+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:25.169 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:24.895+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:25.169 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:24 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:24.895+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:25.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:25 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:25.166+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:25.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:25 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:25.166+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:25.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:25 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:25.166+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:25.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:25.116+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:25.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:25.116+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:25.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:25.116+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:55.878559+0000 front 2024-09-13T18:29:55.878572+0000 (oldest deadline 2024-09-13T18:30:21.778423+0000) 2024-09-13T18:30:25.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:25 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:25.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:25.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:25 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:25.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:25.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:25 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:25.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:25.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:25 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:25.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:25.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:25.723+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:25.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:25.723+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:25.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:25.723+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:25.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:25.723+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:25.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:25.723+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:26.188 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:25 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:25.900+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:26.188 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:25 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:25.900+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:26.189 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:25 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:25.900+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:26.454 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:26 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:26.185+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:26.455 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:26 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:26.185+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:26.455 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:26 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:26.185+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:26.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:26.105+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:26.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:26.105+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:26.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:26.105+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:55.878559+0000 front 2024-09-13T18:29:55.878572+0000 (oldest deadline 2024-09-13T18:30:21.778423+0000) 2024-09-13T18:30:26.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:26.092+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:26.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:26.092+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:26.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:26.092+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:26.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:26 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:26.092+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:26.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:26.673+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:26.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:26.673+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:26.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:26.673+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:26.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:26.674+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:26.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:26 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:26.674+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:27.179 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:26 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:26.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:27.179 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:26 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:26.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:27.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:26 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:26.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:27.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:26 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:26.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:27.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:27 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:27.177+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:27.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:27 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:27.177+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:27.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:27 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:27.177+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:27.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:27.148+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:27.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:27.148+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:27.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:27.148+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:55.878559+0000 front 2024-09-13T18:29:55.878572+0000 (oldest deadline 2024-09-13T18:30:21.778423+0000) 2024-09-13T18:30:27.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:27.111+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:27.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:27.111+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:27.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:27.111+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:27.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:27 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:27.111+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:27.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:27.703+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:27.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:27.703+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:27.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:27.703+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:27.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:27.703+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:27.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:27 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:27.703+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:28.144 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:27 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:27.862+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:28.144 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:27 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:27.862+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:28.144 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:27 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:27.862+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:28.144 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:27 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:27.862+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:28.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:28.141+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:28.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:28.141+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:28.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:28.141+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:28.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:28.141+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:28.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:28.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.574704+0000 front 2024-09-13T18:29:38.574778+0000 (oldest deadline 2024-09-13T18:30:03.275034+0000) 2024-09-13T18:30:28.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:28.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.176917+0000 front 2024-09-13T18:29:47.176997+0000 (oldest deadline 2024-09-13T18:30:11.877013+0000) 2024-09-13T18:30:28.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:28.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:55.878559+0000 front 2024-09-13T18:29:55.878572+0000 (oldest deadline 2024-09-13T18:30:21.778423+0000) 2024-09-13T18:30:28.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7[52790]: 2024-09-13T18:30:28.129+0000 7f6f4a5c1640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.079172+0000 front 2024-09-13T18:30:04.079193+0000 (oldest deadline 2024-09-13T18:30:27.579404+0000) 2024-09-13T18:30:28.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:28.132+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:28.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:28.132+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:28.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:28.132+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:28.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:28 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:28.132+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:28.938 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:28 smithi067 podman[71170]: 2024-09-13 18:30:28.616099037 +0000 UTC m=+5.477016583 container died f2d1524559d0ec7e8b0eb8dfff5b289957b2f7b87ea23ac6dfca94f045d80fa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:30:28.938 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:28.736+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:28.938 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:28.736+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:28.938 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:28.736+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:28.938 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:28.736+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:28.938 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:28 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:28.736+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:29.139 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:28.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:29.139 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:28.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:29.139 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:28.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:29.139 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:28 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:28.865+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:29.229 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 podman[71170]: 2024-09-13 18:30:29.035061356 +0000 UTC m=+5.895978889 container cleanup f2d1524559d0ec7e8b0eb8dfff5b289957b2f7b87ea23ac6dfca94f045d80fa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T18:30:29.229 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 bash[71170]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7 2024-09-13T18:30:29.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:29.136+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:29.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:29.136+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:29.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:29.136+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:29.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:29.136+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:29.497 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 podman[71200]: 2024-09-13 18:30:29.228008749 +0000 UTC m=+0.607583668 container remove f2d1524559d0ec7e8b0eb8dfff5b289957b2f7b87ea23ac6dfca94f045d80fa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T18:30:29.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:29 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:29.091+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:29.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:29 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:29.091+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:29.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:29 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:29.091+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:29.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:29 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:29.091+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:29.958 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 podman[71284]: 2024-09-13 18:30:29.645732601 +0000 UTC m=+0.100514843 container create 2543a924df0d902c5f18d75f114b362b972c581163f0383bffe89806cfb8d7e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:30:29.958 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 podman[71284]: 2024-09-13 18:30:29.561440249 +0000 UTC m=+0.016222471 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:30:29.958 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 podman[71284]: 2024-09-13 18:30:29.872963616 +0000 UTC m=+0.327745817 container init 2543a924df0d902c5f18d75f114b362b972c581163f0383bffe89806cfb8d7e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T18:30:29.958 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 podman[71284]: 2024-09-13 18:30:29.876288786 +0000 UTC m=+0.331070995 container start 2543a924df0d902c5f18d75f114b362b972c581163f0383bffe89806cfb8d7e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-13T18:30:29.958 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:29 smithi067 podman[71284]: 2024-09-13 18:30:29.95619209 +0000 UTC m=+0.410974309 container attach 2543a924df0d902c5f18d75f114b362b972c581163f0383bffe89806cfb8d7e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:30:29.959 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:29 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:29.766+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:29.959 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:29 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:29.766+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:29.959 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:29 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:29.766+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:29.959 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:29 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:29.766+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:29.959 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:29 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:29.766+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:30.115 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:29.851+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:30.115 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:29.851+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:30.115 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:29.851+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:30.115 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:29 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:29.851+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:30.247 INFO:journalctl@ceph.osd.7.smithi067.stdout:Sep 13 18:30:30 smithi067 podman[71284]: 2024-09-13 18:30:30.066618154 +0000 UTC m=+0.521400354 container died 2543a924df0d902c5f18d75f114b362b972c581163f0383bffe89806cfb8d7e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:30:30.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:30.112+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:30.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:30.112+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:30.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:30.112+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:30.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:30.112+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:30.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:30 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:30.093+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:30.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:30 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:30.093+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:30.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:30 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:30.093+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:30.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:30 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:30.093+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:30.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:30 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:30.093+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:30.655 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.7.service' 2024-09-13T18:30:30.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:30:30.737 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-13T18:30:30.737 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-13T18:30:30.737 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.8 2024-09-13T18:30:30.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:30 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:30.754+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:30.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:30 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:30.754+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:30.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:30 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:30.754+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:30.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:30 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:30.754+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:30.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:30 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:30.754+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:31.035 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:30 smithi116 systemd[1]: Stopping Ceph osd.8 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:30:31.035 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:30.896+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:31.035 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:30.896+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:31.035 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:30.896+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:31.035 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:30 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:30.896+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:31.035 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:31.032+0000 7f22e50f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:30:31.035 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:31.032+0000 7f22e50f8640 -1 osd.8 91 *** Got signal Terminated *** 2024-09-13T18:30:31.036 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:31.032+0000 7f22e50f8640 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:31.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:31.077+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:31.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:31.077+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:31.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:31.077+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:31.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:31.077+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:31.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:31 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:31.139+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:31.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:31 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:31.139+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:31.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:31 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:31.139+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:31.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:31 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:31.139+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:31.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:31 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:31.139+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:32.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:31.917+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:32.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:31.917+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:32.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:31.917+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:32.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:31 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:31.917+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:32.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:32.127+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:32.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:32.127+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:32.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:32.127+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:32.212 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:32.127+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:32.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:31 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:31.771+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:32.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:31 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:31.771+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:32.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:31 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:31.771+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:32.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:31 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:31.771+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:32.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:31 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:31.771+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:32.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:32 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:32.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:32.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:32 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:32.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:32.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:32 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:32.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:32.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:32 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:32.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:32.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:32 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:32.140+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:33.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:32.941+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:33.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:32.941+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:33.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:32.941+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:33.211 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:32 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:32.941+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:33.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:33.078+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:33.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:33.078+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:33.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:33.078+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:33.212 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:33.078+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:33.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:32 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:32.788+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:33.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:32 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:32.788+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:33.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:32 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:32.788+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:33.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:32 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:32.788+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:33.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:32 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:32.788+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:33.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:32 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:32.788+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:33.442 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:33 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:33.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:33.442 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:33 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:33.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:33.443 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:33 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:33.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:33.443 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:33 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:33.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:33.443 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:33 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:33.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:33.443 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:33 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:33.117+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:34.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:33 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:33.746+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:34.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:33 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:33.746+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:34.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:33 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:33.746+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:34.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:33 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:33.746+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:34.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:33 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:33.746+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:34.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:33 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:33.746+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:34.460 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:33.973+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:33.973+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:33.973+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:33.973+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:34.038+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:34.038+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:34.038+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:34.038+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:34.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:34.038+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:34.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:34.121+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:34.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:34.121+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:34.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:34.121+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:34.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:34.121+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:34.542 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:34.121+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:34.542 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:34 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:34.121+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:35.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:34 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:34.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:35.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:34 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:34.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:35.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:34 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:34.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:35.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:34 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:34.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:35.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:34 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:34.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:35.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:34 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:34.760+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:35.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:35.165+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:35.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:35.165+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:35.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:35.165+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:35.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:35.165+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:35.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:35.165+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:35.291 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:35 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:35.165+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:35.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:34.960+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:35.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:34.960+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:35.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:34.960+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:35.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:34.960+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:35.461 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:34 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:34.960+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.071600+0000 front 2024-09-13T18:30:12.071631+0000 (oldest deadline 2024-09-13T18:30:34.371767+0000) 2024-09-13T18:30:35.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:35.047+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:35.462 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:35.047+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:35.462 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:35.047+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:35.462 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:35.047+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:35.462 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:35.047+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:36.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:35.757+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:36.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:35.757+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:36.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:35.757+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:36.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:35.757+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:36.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:35.757+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:36.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:35 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:35.757+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:36.436 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.001+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:36.436 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.001+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.001+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.001+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.001+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:35.970+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.766821+0000 front 2024-09-13T18:29:38.766767+0000 (oldest deadline 2024-09-13T18:30:02.266947+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:35.970+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:48.168044+0000 front 2024-09-13T18:29:48.168209+0000 (oldest deadline 2024-09-13T18:30:13.468273+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:35.970+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.468924+0000 front 2024-09-13T18:29:53.468963+0000 (oldest deadline 2024-09-13T18:30:18.768749+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:35.970+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.470687+0000 front 2024-09-13T18:30:04.470643+0000 (oldest deadline 2024-09-13T18:30:26.770617+0000) 2024-09-13T18:30:36.437 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:35 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8[53592]: 2024-09-13T18:30:35.970+0000 7f22e1efc640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.071600+0000 front 2024-09-13T18:30:12.071631+0000 (oldest deadline 2024-09-13T18:30:34.371767+0000) 2024-09-13T18:30:36.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:36 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:36.170+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:36.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:36 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:36.170+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:36.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:36 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:36.170+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:36.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:36 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:36.170+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:36.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:36 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:36.170+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:36.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:36 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:36.170+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:36.710 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:36 smithi116 podman[71260]: 2024-09-13 18:30:36.434413655 +0000 UTC m=+5.504440010 container died 8a7987b1429498a6e7527948bad4caa1c47a8dcbaf58c2dad6512ebf21f890fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T18:30:36.960 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:36 smithi116 podman[71260]: 2024-09-13 18:30:36.807633799 +0000 UTC m=+5.877660140 container cleanup 8a7987b1429498a6e7527948bad4caa1c47a8dcbaf58c2dad6512ebf21f890fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T18:30:36.960 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:36 smithi116 bash[71260]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8 2024-09-13T18:30:37.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:36 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:36.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:37.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:36 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:36.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:37.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:36 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:36.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:37.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:36 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:36.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:37.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:36 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:36.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:37.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:36 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:36.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:37.381 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:37 smithi116 podman[71276]: 2024-09-13 18:30:37.067222012 +0000 UTC m=+0.630511722 container remove 8a7987b1429498a6e7527948bad4caa1c47a8dcbaf58c2dad6512ebf21f890fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T18:30:37.381 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.960+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:37.381 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.961+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:37.381 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.961+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:37.381 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.961+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:37.381 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:36.961+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:37.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:37.200+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:37.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:37.200+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:37.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:37.200+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:37.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:37.200+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:37.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:37.200+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:37.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:37 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:37.200+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:37.672 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:37 smithi116 podman[71368]: 2024-09-13 18:30:37.281546655 +0000 UTC m=+0.015577500 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:30:37.672 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:37 smithi116 podman[71368]: 2024-09-13 18:30:37.384464769 +0000 UTC m=+0.118495608 container create e0c022b054e0d3b2c0c452ade685a26b4f70ef99d861baba76db82483b011721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T18:30:37.672 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:37 smithi116 podman[71368]: 2024-09-13 18:30:37.603528321 +0000 UTC m=+0.337559161 container init e0c022b054e0d3b2c0c452ade685a26b4f70ef99d861baba76db82483b011721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:30:37.672 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:37 smithi116 podman[71368]: 2024-09-13 18:30:37.606821652 +0000 UTC m=+0.340852503 container start e0c022b054e0d3b2c0c452ade685a26b4f70ef99d861baba76db82483b011721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T18:30:37.672 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:37 smithi116 podman[71368]: 2024-09-13 18:30:37.670131852 +0000 UTC m=+0.404162693 container attach e0c022b054e0d3b2c0c452ade685a26b4f70ef99d861baba76db82483b011721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T18:30:37.961 INFO:journalctl@ceph.osd.8.smithi116.stdout:Sep 13 18:30:37 smithi116 podman[71368]: 2024-09-13 18:30:37.793908453 +0000 UTC m=+0.527939293 container died e0c022b054e0d3b2c0c452ade685a26b4f70ef99d861baba76db82483b011721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T18:30:38.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:37.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:38.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:37.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:38.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:37.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:38.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:37.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:38.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:37.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:38.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:37 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:37.751+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:38.460 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:37 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:37.994+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:38.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:37 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:37.994+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:38.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:37 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:37.994+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:38.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:37 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:37.994+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:38.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:37 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:37.994+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:38.498 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.8.service' 2024-09-13T18:30:38.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:30:38.539 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-13T18:30:38.539 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-13T18:30:38.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.9 2024-09-13T18:30:38.544 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.188+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:38.544 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.188+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:38.544 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.188+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:38.544 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.188+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:38.544 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.188+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:38.544 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.188+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:38.973 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 systemd[1]: Stopping Ceph osd.9 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:30:39.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:38 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:38.944+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:39.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:38 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:38.944+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:39.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:38 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:38.944+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:39.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:38 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:38.944+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:39.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:38 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:38.944+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:39.236 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.970+0000 7f45eda00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:30:39.236 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.970+0000 7f45eda00640 -1 osd.9 91 *** Got signal Terminated *** 2024-09-13T18:30:39.236 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:38 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:38.970+0000 7f45eda00640 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:39.236 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:39.234+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:39.236 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:39.234+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:39.236 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:39.234+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:39.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:38 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:38.789+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:39.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:38 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:38.789+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:39.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:38 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:38.789+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:39.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:38 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:38.789+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:39.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:38 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:38.789+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:39.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:38 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:38.789+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:39.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:39.234+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:39.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:39.234+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:39.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:39 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:39.234+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:39.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:39 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:39.905+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:39.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:39 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:39.905+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:39.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:39 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:39.905+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:39.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:39 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:39.905+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:39.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:39 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:39.905+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:40.132 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:39 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:39.794+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:40.133 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:39 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:39.794+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:40.133 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:39 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:39.794+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:40.133 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:39 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:39.794+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:40.133 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:39 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:39.794+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:40.133 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:39 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:39.794+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:40.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:40 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:40.281+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:40.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:40 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:40.281+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:40.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:40 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:40.281+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:40.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:40 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:40.281+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:40.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:40 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:40.281+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:40.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:40 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:40.281+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:41.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:40 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:40.885+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:41.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:40 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:40.885+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:41.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:40 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:40.885+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:41.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:40 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:40.885+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:41.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:40 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:40.885+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:41.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:40 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:40.784+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:41.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:40 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:40.784+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:41.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:40 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:40.784+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:41.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:40 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:40.784+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:41.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:40 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:40.784+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:41.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:40 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:40.784+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:41.792 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:41 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:41.301+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:41.792 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:41 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:41.301+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:41.792 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:41 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:41.301+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:41.793 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:41 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:41.301+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:41.793 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:41 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:41.301+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:41.793 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:41 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:41.301+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:41.793 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:41 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:41.301+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:18.035545+0000 front 2024-09-13T18:30:18.035556+0000 (oldest deadline 2024-09-13T18:30:40.935632+0000) 2024-09-13T18:30:42.210 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:41 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:41.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:42.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:41 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:41.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:42.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:41 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:41.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:42.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:41 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:41.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:42.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:41 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:41.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:42.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:41 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:41.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:42.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:41 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:41.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:42.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:41 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:41.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:42.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:41 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:41.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:42.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:41 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:41.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:42.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:41 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:41.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:42.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:41 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:41.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:42.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:42.337+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:42.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:42.337+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:42.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:42.337+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:42.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:42.337+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:42.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:42.337+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:42.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:42.337+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:42.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:42 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:42.337+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:18.035545+0000 front 2024-09-13T18:30:18.035556+0000 (oldest deadline 2024-09-13T18:30:40.935632+0000) 2024-09-13T18:30:43.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:42 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:42.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:43.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:42 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:42.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:43.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:42 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:42.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:43.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:42 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:42.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:43.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:42 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:42.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:43.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:42 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:42.850+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:43.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:42.878+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:43.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:42.878+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:43.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:42.878+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:43.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:42.878+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:43.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:42.878+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:43.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:42.878+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:43.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:42 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:42.878+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:43.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:43 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:43.320+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.828648+0000 front 2024-09-13T18:29:30.828747+0000 (oldest deadline 2024-09-13T18:29:56.728753+0000) 2024-09-13T18:30:43.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:43 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:43.320+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:39.530467+0000 front 2024-09-13T18:29:39.530621+0000 (oldest deadline 2024-09-13T18:30:05.430310+0000) 2024-09-13T18:30:43.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:43 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:43.320+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.131416+0000 front 2024-09-13T18:29:47.131450+0000 (oldest deadline 2024-09-13T18:30:13.031310+0000) 2024-09-13T18:30:43.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:43 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:43.320+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:53.031759+0000 front 2024-09-13T18:29:53.031878+0000 (oldest deadline 2024-09-13T18:30:17.731656+0000) 2024-09-13T18:30:43.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:43 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:43.320+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:03.032659+0000 front 2024-09-13T18:30:03.032847+0000 (oldest deadline 2024-09-13T18:30:29.433346+0000) 2024-09-13T18:30:43.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:43 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:43.320+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:09.433877+0000 front 2024-09-13T18:30:09.434041+0000 (oldest deadline 2024-09-13T18:30:32.933858+0000) 2024-09-13T18:30:43.791 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:43 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9[64683]: 2024-09-13T18:30:43.320+0000 7f45e9e00640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:18.035545+0000 front 2024-09-13T18:30:18.035556+0000 (oldest deadline 2024-09-13T18:30:40.935632+0000) 2024-09-13T18:30:44.210 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:43.846+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:44.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:43.846+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:44.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:43.846+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:44.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:43.846+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:44.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:43.846+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:44.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:43 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:43.846+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:44.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:43 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:43.866+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:44.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:43 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:43.866+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:44.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:43 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:43.866+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:44.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:43 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:43.866+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:44.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:43 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:43.866+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:44.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:43 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:43.866+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:44.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:43 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:43.866+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:44.790 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:44 smithi007 podman[87009]: 2024-09-13 18:30:44.532336367 +0000 UTC m=+5.704184374 container died 5a7f9ca8e1a2d7fd49cb57bd533882398789b3b4c8d896157cce7bc7a476538e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:30:45.170 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:44 smithi007 podman[87009]: 2024-09-13 18:30:44.933251801 +0000 UTC m=+6.105099806 container cleanup 5a7f9ca8e1a2d7fd49cb57bd533882398789b3b4c8d896157cce7bc7a476538e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2) 2024-09-13T18:30:45.170 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:44 smithi007 bash[87009]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9 2024-09-13T18:30:45.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:44 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:44.801+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:45.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:44 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:44.801+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:45.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:44 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:44.801+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:45.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:44 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:44.801+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:45.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:44 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:44.801+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:45.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:44 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:44.801+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:45.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:44 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:44.852+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:45.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:44 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:44.852+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:45.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:44 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:44.852+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:45.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:44 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:44.852+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:45.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:44 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:44.852+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:45.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:44 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:44.852+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:45.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:44 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:44.852+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:45.541 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:45 smithi007 podman[87026]: 2024-09-13 18:30:45.167581923 +0000 UTC m=+0.627256755 container remove 5a7f9ca8e1a2d7fd49cb57bd533882398789b3b4c8d896157cce7bc7a476538e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:30:46.031 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:45 smithi007 podman[87110]: 2024-09-13 18:30:45.726748336 +0000 UTC m=+0.120656424 container create 978c60fe9e99c07caa0b93dae0bb03c2f8f0a8937db0fc33ba9c368e3b87efdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T18:30:46.031 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:45 smithi007 podman[87110]: 2024-09-13 18:30:45.633528306 +0000 UTC m=+0.027436393 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:30:46.031 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:45 smithi007 podman[87110]: 2024-09-13 18:30:45.945890261 +0000 UTC m=+0.339798348 container init 978c60fe9e99c07caa0b93dae0bb03c2f8f0a8937db0fc33ba9c368e3b87efdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:30:46.031 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:45 smithi007 podman[87110]: 2024-09-13 18:30:45.952554467 +0000 UTC m=+0.346462555 container start 978c60fe9e99c07caa0b93dae0bb03c2f8f0a8937db0fc33ba9c368e3b87efdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T18:30:46.031 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:46 smithi007 podman[87110]: 2024-09-13 18:30:46.028902615 +0000 UTC m=+0.422810712 container attach 978c60fe9e99c07caa0b93dae0bb03c2f8f0a8937db0fc33ba9c368e3b87efdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T18:30:46.210 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:45.812+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:46.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:45.812+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:46.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:45.812+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:46.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:45.812+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:46.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:45.812+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:46.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:45.812+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:46.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:45 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:45.857+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:46.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:45 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:45.857+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:46.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:45 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:45.857+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:46.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:45 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:45.857+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:46.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:45 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:45.857+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:46.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:45 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:45.857+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:46.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:45 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:45.857+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:46.290 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 13 18:30:46 smithi007 podman[87110]: 2024-09-13 18:30:46.211238006 +0000 UTC m=+0.605146104 container died 978c60fe9e99c07caa0b93dae0bb03c2f8f0a8937db0fc33ba9c368e3b87efdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T18:30:46.885 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.9.service' 2024-09-13T18:30:46.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:30:46.964 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-13T18:30:46.964 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-13T18:30:46.965 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.10 2024-09-13T18:30:47.210 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:46 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:46.825+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:47.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:46 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:46.825+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:47.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:46 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:46.825+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:47.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:46 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:46.825+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:47.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:46 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:46.825+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:47.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:46 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:46.825+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:47.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:46 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:46.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:47.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:46 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:46.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:47.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:46 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:46.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:47.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:46 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:46.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:47.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:46 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:46.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:47.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:46 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:46.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:47.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:46 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:46.832+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:47.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 systemd[1]: Stopping Ceph osd.10 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:30:47.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.270+0000 7f8a14cb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:30:47.747 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.270+0000 7f8a14cb4640 -1 osd.10 91 *** Got signal Terminated *** 2024-09-13T18:30:47.748 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.270+0000 7f8a14cb4640 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:48.210 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:47.813+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:48.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:47.813+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:48.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:47.813+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:48.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:47.813+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:48.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:47.813+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:48.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:47 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:47.813+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:48.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:48.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:48.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:48.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:48.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:48.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:48.248 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:47 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:47.785+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:49.210 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:48 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:48.772+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:49.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:48 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:48.772+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:49.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:48 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:48.772+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:49.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:48 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:48.772+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:49.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:48 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:48.772+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:49.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:48 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:48.772+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:49.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:48 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:48.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:49.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:48 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:48.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:49.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:48 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:48.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:49.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:48 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:48.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:49.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:48 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:48.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:49.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:48 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:48.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:49.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:48 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:48.764+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:49.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:49.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:49.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:49.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:49.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:49.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:49.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:49.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:49.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:49.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:49.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:49 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:49.717+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:50.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:49 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:49.775+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:50.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:49 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:49.775+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:50.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:49 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:49.775+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:50.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:49 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:49.775+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:50.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:49 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:49.775+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:50.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:49 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:49.775+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:50.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:49 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:49.775+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:50.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:50.677+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:50.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:50.677+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:50.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:50.677+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:50.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:50.677+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:50.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:50.677+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:50.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:50.677+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:50.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:50 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:50.677+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:51.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:50 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:50.797+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:51.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:50 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:50.797+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:51.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:50 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:50.797+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:51.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:50 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:50.797+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:51.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:50 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:50.797+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:51.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:50 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:50.797+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:51.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:50 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:50.797+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:51.997 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:51.680+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:30.511940+0000 front 2024-09-13T18:29:30.511855+0000 (oldest deadline 2024-09-13T18:29:54.512464+0000) 2024-09-13T18:30:51.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:51.680+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:40.214370+0000 front 2024-09-13T18:29:40.214398+0000 (oldest deadline 2024-09-13T18:30:03.714504+0000) 2024-09-13T18:30:51.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:51.680+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.215495+0000 front 2024-09-13T18:29:47.215448+0000 (oldest deadline 2024-09-13T18:30:10.016061+0000) 2024-09-13T18:30:51.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:51.680+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-13T18:29:54.017459+0000 front 2024-09-13T18:29:54.017518+0000 (oldest deadline 2024-09-13T18:30:16.917571+0000) 2024-09-13T18:30:51.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:51.680+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:01.618379+0000 front 2024-09-13T18:30:01.618347+0000 (oldest deadline 2024-09-13T18:30:25.118437+0000) 2024-09-13T18:30:51.998 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:51.680+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:10.920388+0000 front 2024-09-13T18:30:10.920291+0000 (oldest deadline 2024-09-13T18:30:32.620081+0000) 2024-09-13T18:30:51.999 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:51 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10[59823]: 2024-09-13T18:30:51.680+0000 7f8a11ab8640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:14.921014+0000 front 2024-09-13T18:30:14.921002+0000 (oldest deadline 2024-09-13T18:30:40.820934+0000) 2024-09-13T18:30:52.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:51 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:51.754+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:52.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:51 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:51.754+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:52.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:51 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:51.754+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:52.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:51 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:51.754+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:52.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:51 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:51.754+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:52.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:51 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:51.754+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:52.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:51 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:51.754+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:52.848 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:52 smithi067 podman[71387]: 2024-09-13 18:30:52.591824475 +0000 UTC m=+5.423851528 container died d18bea4092901df7271fe707e4a48125ecb46d9186bb2a07a0ea200d481f4f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T18:30:53.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:52.737+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:53.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:52.737+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:53.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:52.737+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:53.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:52.737+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:53.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:52.737+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:53.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:52.737+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:53.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:52 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:52.737+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:53.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:53 smithi067 podman[71387]: 2024-09-13 18:30:53.045108497 +0000 UTC m=+5.877135550 container cleanup d18bea4092901df7271fe707e4a48125ecb46d9186bb2a07a0ea200d481f4f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:30:53.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:53 smithi067 bash[71387]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10 2024-09-13T18:30:53.667 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:53 smithi067 podman[71401]: 2024-09-13 18:30:53.346131594 +0000 UTC m=+0.745021543 container remove d18bea4092901df7271fe707e4a48125ecb46d9186bb2a07a0ea200d481f4f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T18:30:53.951 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:53 smithi067 podman[71492]: 2024-09-13 18:30:53.568386681 +0000 UTC m=+0.015511197 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:30:53.952 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:53 smithi067 podman[71492]: 2024-09-13 18:30:53.83019932 +0000 UTC m=+0.277323821 container create d2465447717b2b83dd031fa3d32bd79a81ac087b8be8880f44161b7211a2a6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:30:54.212 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:53.711+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:54.213 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:53.711+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:54.213 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:53.711+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:54.213 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:53.711+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:54.213 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:53.711+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:54.213 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:53.711+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:54.213 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:53 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:53.711+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:54.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:54 smithi067 podman[71492]: 2024-09-13 18:30:54.057960875 +0000 UTC m=+0.505085393 container init d2465447717b2b83dd031fa3d32bd79a81ac087b8be8880f44161b7211a2a6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T18:30:54.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:54 smithi067 podman[71492]: 2024-09-13 18:30:54.061309866 +0000 UTC m=+0.508434366 container start d2465447717b2b83dd031fa3d32bd79a81ac087b8be8880f44161b7211a2a6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:30:54.247 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:54 smithi067 podman[71492]: 2024-09-13 18:30:54.140860427 +0000 UTC m=+0.587984927 container attach d2465447717b2b83dd031fa3d32bd79a81ac087b8be8880f44161b7211a2a6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T18:30:54.536 INFO:journalctl@ceph.osd.10.smithi067.stdout:Sep 13 18:30:54 smithi067 podman[71492]: 2024-09-13 18:30:54.251878436 +0000 UTC m=+0.699002935 container died d2465447717b2b83dd031fa3d32bd79a81ac087b8be8880f44161b7211a2a6bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:30:54.833 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.10.service' 2024-09-13T18:30:54.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:30:54.871 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-13T18:30:54.871 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-13T18:30:54.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.11 2024-09-13T18:30:54.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:54.690+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:54.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:54.690+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:54.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:54.690+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:54.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:54.690+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:54.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:54.690+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:54.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:54.690+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:54.962 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:54.690+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:54.962 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:54 smithi116 systemd[1]: Stopping Ceph osd.11 for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:30:55.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.159+0000 7fe3bc771640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:30:55.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.159+0000 7fe3bc771640 -1 osd.11 91 *** Got signal Terminated *** 2024-09-13T18:30:55.461 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.159+0000 7fe3bc771640 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:30:55.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.706+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:55.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.706+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:55.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.706+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:55.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.706+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:55.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.706+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:55.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.706+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:55.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:55 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:55.706+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:56.960 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:56.667+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:56.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:56.667+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:56.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:56.667+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:56.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:56.667+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:56.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:56.667+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:56.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:56.667+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:56.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:56 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:56.667+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:57.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:57 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:57.697+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6820 osd.8 since back 2024-09-13T18:30:35.987707+0000 front 2024-09-13T18:30:35.987724+0000 (oldest deadline 2024-09-13T18:30:57.087700+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:59.211 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:58 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:58.732+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6820 osd.8 since back 2024-09-13T18:30:35.987707+0000 front 2024-09-13T18:30:35.987724+0000 (oldest deadline 2024-09-13T18:30:57.087700+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-13T18:29:28.977688+0000 front 2024-09-13T18:29:28.977703+0000 (oldest deadline 2024-09-13T18:29:54.277620+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6804 osd.1 since back 2024-09-13T18:29:38.379022+0000 front 2024-09-13T18:29:38.378994+0000 (oldest deadline 2024-09-13T18:30:03.678951+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2024-09-13T18:29:47.780001+0000 front 2024-09-13T18:29:47.779840+0000 (oldest deadline 2024-09-13T18:30:13.680004+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6812 osd.4 since back 2024-09-13T18:30:04.082360+0000 front 2024-09-13T18:30:04.082383+0000 (oldest deadline 2024-09-13T18:30:28.083147+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2024-09-13T18:30:12.183899+0000 front 2024-09-13T18:30:12.183924+0000 (oldest deadline 2024-09-13T18:30:33.284028+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-13T18:30:19.185080+0000 front 2024-09-13T18:30:19.185093+0000 (oldest deadline 2024-09-13T18:30:42.084846+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.67:6820 osd.7 since back 2024-09-13T18:30:26.686201+0000 front 2024-09-13T18:30:26.686299+0000 (oldest deadline 2024-09-13T18:30:48.986236+0000) 2024-09-13T18:30:59.961 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:30:59 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11[60458]: 2024-09-13T18:30:59.686+0000 7fe3b556d640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.116:6820 osd.8 since back 2024-09-13T18:30:35.987707+0000 front 2024-09-13T18:30:35.987724+0000 (oldest deadline 2024-09-13T18:30:57.087700+0000) 2024-09-13T18:31:00.738 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:00 smithi116 podman[71481]: 2024-09-13 18:31:00.469631812 +0000 UTC m=+5.403862681 container died 9ce414685bec6ce102ccd6ecf360da8807891620b537ad7ce70e1e6937c04985 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T18:31:01.104 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:00 smithi116 podman[71481]: 2024-09-13 18:31:00.834719641 +0000 UTC m=+5.768950500 container cleanup 9ce414685bec6ce102ccd6ecf360da8807891620b537ad7ce70e1e6937c04985 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:31:01.104 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:00 smithi116 bash[71481]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11 2024-09-13T18:31:01.454 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:01 smithi116 podman[71509]: 2024-09-13 18:31:01.102471974 +0000 UTC m=+0.625666594 container remove 9ce414685bec6ce102ccd6ecf360da8807891620b537ad7ce70e1e6937c04985 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-13T18:31:01.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:01 smithi116 podman[71598]: 2024-09-13 18:31:01.355489463 +0000 UTC m=+0.015662394 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:31:01.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:01 smithi116 podman[71598]: 2024-09-13 18:31:01.453103163 +0000 UTC m=+0.113276085 container create 98d04872fe1989e3860d2421e5542b558bbed324394be0325b80d5e0913afd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:31:01.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:01 smithi116 podman[71598]: 2024-09-13 18:31:01.647305179 +0000 UTC m=+0.307478108 container init 98d04872fe1989e3860d2421e5542b558bbed324394be0325b80d5e0913afd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T18:31:01.711 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:01 smithi116 podman[71598]: 2024-09-13 18:31:01.650642217 +0000 UTC m=+0.310815137 container start 98d04872fe1989e3860d2421e5542b558bbed324394be0325b80d5e0913afd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:31:02.118 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:01 smithi116 podman[71598]: 2024-09-13 18:31:01.738604417 +0000 UTC m=+0.398777339 container attach 98d04872fe1989e3860d2421e5542b558bbed324394be0325b80d5e0913afd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T18:31:02.118 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:01 smithi116 podman[71598]: 2024-09-13 18:31:01.837511711 +0000 UTC m=+0.497684631 container died 98d04872fe1989e3860d2421e5542b558bbed324394be0325b80d5e0913afd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T18:31:02.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.11.service' 2024-09-13T18:31:02.370 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:02 smithi116 podman[71621]: 2024-09-13 18:31:02.316619453 +0000 UTC m=+0.469273305 container remove 98d04872fe1989e3860d2421e5542b558bbed324394be0325b80d5e0913afd99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T18:31:02.370 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:02 smithi116 systemd[1]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.11.service: Deactivated successfully. 2024-09-13T18:31:02.370 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:02 smithi116 systemd[1]: Stopped Ceph osd.11 for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:31:02.371 INFO:journalctl@ceph.osd.11.smithi116.stdout:Sep 13 18:31:02 smithi116 systemd[1]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968@osd.11.service: Consumed 7.590s CPU time. 2024-09-13T18:31:02.386 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:02.386 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-13T18:31:02.386 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-13T18:31:02.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.a 2024-09-13T18:31:02.789 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:31:02 smithi007 systemd[1]: Stopping Ceph mds.a for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:03.041 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:31:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a[71519]: 2024-09-13T18:31:02.785+0000 7fb56a800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:03.041 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:31:02 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a[71519]: 2024-09-13T18:31:02.785+0000 7fb56a800640 -1 mds.a *** got signal Terminated *** 2024-09-13T18:31:04.041 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:31:03 smithi007 podman[87221]: 2024-09-13 18:31:03.888483244 +0000 UTC m=+1.215491123 container died 7d42e4c1aeb6ccda321e2e50fd3a77d15e6556d726b9d7f3acb2243db6d3ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:31:04.541 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:31:04 smithi007 podman[87221]: 2024-09-13 18:31:04.299848173 +0000 UTC m=+1.626856052 container cleanup 7d42e4c1aeb6ccda321e2e50fd3a77d15e6556d726b9d7f3acb2243db6d3ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:31:04.541 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 13 18:31:04 smithi007 bash[87221]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-a 2024-09-13T18:31:04.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.a.service' 2024-09-13T18:31:04.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:04.811 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-13T18:31:04.811 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-13T18:31:04.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.d 2024-09-13T18:31:05.209 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:31:04 smithi007 systemd[1]: Stopping Ceph mds.d for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:05.541 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:31:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-d[70618]: 2024-09-13T18:31:05.205+0000 7f3b81a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:05.541 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:31:05 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-d[70618]: 2024-09-13T18:31:05.205+0000 7f3b81a00640 -1 mds.d *** got signal Terminated *** 2024-09-13T18:31:08.749 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:31:08 smithi007 podman[87349]: 2024-09-13 18:31:08.477005396 +0000 UTC m=+3.391076697 container died 0d6d21448b4a34f95bd8e6b480d993a3dfcbd14c8e8e1a4166810644ea93ac9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T18:31:09.041 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:31:08 smithi007 podman[87349]: 2024-09-13 18:31:08.886530975 +0000 UTC m=+3.800602272 container cleanup 0d6d21448b4a34f95bd8e6b480d993a3dfcbd14c8e8e1a4166810644ea93ac9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:31:09.041 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:31:08 smithi007 bash[87349]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-d 2024-09-13T18:31:09.359 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 13 18:31:09 smithi007 podman[87360]: 2024-09-13 18:31:09.079615307 +0000 UTC m=+0.589408129 container remove 0d6d21448b4a34f95bd8e6b480d993a3dfcbd14c8e8e1a4166810644ea93ac9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T18:31:09.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.d.service' 2024-09-13T18:31:09.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:09.456 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-13T18:31:09.457 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-13T18:31:09.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.g 2024-09-13T18:31:09.790 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:31:09 smithi007 systemd[1]: Stopping Ceph mds.g for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:10.291 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:31:09 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g[71170]: 2024-09-13T18:31:09.892+0000 7f4ded200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:10.291 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:31:09 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g[71170]: 2024-09-13T18:31:09.892+0000 7f4ded200640 -1 mds.g *** got signal Terminated *** 2024-09-13T18:31:12.204 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:31:11 smithi007 podman[87472]: 2024-09-13 18:31:11.92104683 +0000 UTC m=+2.150839665 container died cf13c7c6ff91fe39cc7e354215b92b9bc77661f7d40109e9b1fa178d277225f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:31:12.541 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:31:12 smithi007 podman[87472]: 2024-09-13 18:31:12.331498894 +0000 UTC m=+2.561291728 container cleanup cf13c7c6ff91fe39cc7e354215b92b9bc77661f7d40109e9b1fa178d277225f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:31:12.541 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:31:12 smithi007 bash[87472]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g 2024-09-13T18:31:12.863 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 13 18:31:12 smithi007 podman[87484]: 2024-09-13 18:31:12.574417433 +0000 UTC m=+0.644936228 container remove cf13c7c6ff91fe39cc7e354215b92b9bc77661f7d40109e9b1fa178d277225f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:31:12.881 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.g.service' 2024-09-13T18:31:12.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:12.951 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-13T18:31:12.951 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-13T18:31:12.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.j 2024-09-13T18:31:13.291 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:31:13 smithi007 systemd[1]: Stopping Ceph mds.j for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:13.791 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:31:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j[70238]: 2024-09-13T18:31:13.345+0000 7fb6e4a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:13.791 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:31:13 smithi007 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j[70238]: 2024-09-13T18:31:13.345+0000 7fb6e4a00640 -1 mds.j *** got signal Terminated *** 2024-09-13T18:31:16.152 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:31:15 smithi007 podman[87589]: 2024-09-13 18:31:15.887341872 +0000 UTC m=+2.662180205 container died ad82d47b1236d073848d0be9848c093b127b4bf9fbe72e4bd7e9c93575a83126 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:31:16.455 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:31:16 smithi007 podman[87589]: 2024-09-13 18:31:16.243958895 +0000 UTC m=+3.018797231 container cleanup ad82d47b1236d073848d0be9848c093b127b4bf9fbe72e4bd7e9c93575a83126 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T18:31:16.455 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:31:16 smithi007 bash[87589]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j 2024-09-13T18:31:16.725 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 13 18:31:16 smithi007 podman[87601]: 2024-09-13 18:31:16.453220744 +0000 UTC m=+0.553686653 container remove ad82d47b1236d073848d0be9848c093b127b4bf9fbe72e4bd7e9c93575a83126 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:31:16.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.j.service' 2024-09-13T18:31:16.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:16.815 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-13T18:31:16.815 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-13T18:31:16.816 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.b 2024-09-13T18:31:17.240 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:31:16 smithi067 systemd[1]: Stopping Ceph mds.b for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:17.497 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:31:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: 2024-09-13T18:31:17.237+0000 7f3a4213b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:17.497 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:31:17 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b[65482]: 2024-09-13T18:31:17.237+0000 7f3a4213b640 -1 mds.b *** got signal Terminated *** 2024-09-13T18:31:20.240 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:31:19 smithi067 podman[71595]: 2024-09-13 18:31:19.877255107 +0000 UTC m=+2.868821127 container died e350fd39731f81f7fe0ae09fd34637143b874703cce212da0309f33ae2c2da43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:31:20.497 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:31:20 smithi067 podman[71595]: 2024-09-13 18:31:20.320202149 +0000 UTC m=+3.311768166 container cleanup e350fd39731f81f7fe0ae09fd34637143b874703cce212da0309f33ae2c2da43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T18:31:20.497 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:31:20 smithi067 bash[71595]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b 2024-09-13T18:31:20.497 INFO:journalctl@ceph.mds.b.smithi067.stdout:Sep 13 18:31:20 smithi067 podman[71607]: 2024-09-13 18:31:20.487959975 +0000 UTC m=+0.607110529 container remove e350fd39731f81f7fe0ae09fd34637143b874703cce212da0309f33ae2c2da43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:31:20.746 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.b.service' 2024-09-13T18:31:20.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:20.779 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-13T18:31:20.779 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-13T18:31:20.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.e 2024-09-13T18:31:20.997 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:31:20 smithi067 systemd[1]: Stopping Ceph mds.e for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:21.497 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:31:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e[64867]: 2024-09-13T18:31:21.089+0000 7f371efaa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:21.497 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:31:21 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e[64867]: 2024-09-13T18:31:21.089+0000 7f371efaa640 -1 mds.e *** got signal Terminated *** 2024-09-13T18:31:24.175 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:31:23 smithi067 podman[71718]: 2024-09-13 18:31:23.867445625 +0000 UTC m=+2.870449575 container died 722396f69cb4c6fbc2933c24a0cf522b2ad8587ea55ea9f7225b6c23ef725e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T18:31:24.497 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:31:24 smithi067 podman[71718]: 2024-09-13 18:31:24.174017513 +0000 UTC m=+3.177021464 container cleanup 722396f69cb4c6fbc2933c24a0cf522b2ad8587ea55ea9f7225b6c23ef725e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T18:31:24.497 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:31:24 smithi067 bash[71718]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e 2024-09-13T18:31:24.497 INFO:journalctl@ceph.mds.e.smithi067.stdout:Sep 13 18:31:24 smithi067 podman[71731]: 2024-09-13 18:31:24.375165189 +0000 UTC m=+0.504236613 container remove 722396f69cb4c6fbc2933c24a0cf522b2ad8587ea55ea9f7225b6c23ef725e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:31:24.627 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.e.service' 2024-09-13T18:31:24.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:24.660 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-13T18:31:24.661 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-13T18:31:24.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.h 2024-09-13T18:31:24.997 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:31:24 smithi067 systemd[1]: Stopping Ceph mds.h for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:25.497 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:31:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h[65167]: 2024-09-13T18:31:25.035+0000 7fd1f0b00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:25.497 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:31:25 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h[65167]: 2024-09-13T18:31:25.035+0000 7fd1f0b00640 -1 mds.h *** got signal Terminated *** 2024-09-13T18:31:28.248 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:31:27 smithi067 podman[71840]: 2024-09-13 18:31:27.864415904 +0000 UTC m=+2.980495043 container died 418d363034d35bd21f5141f898d8f9d6a6429f205d6649b1f4c734f57b407083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:31:28.724 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:31:28 smithi067 podman[71840]: 2024-09-13 18:31:28.369520161 +0000 UTC m=+3.485599290 container cleanup 418d363034d35bd21f5141f898d8f9d6a6429f205d6649b1f4c734f57b407083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T18:31:28.724 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:31:28 smithi067 bash[71840]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h 2024-09-13T18:31:28.724 INFO:journalctl@ceph.mds.h.smithi067.stdout:Sep 13 18:31:28 smithi067 podman[71862]: 2024-09-13 18:31:28.520612806 +0000 UTC m=+0.650295925 container remove 418d363034d35bd21f5141f898d8f9d6a6429f205d6649b1f4c734f57b407083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T18:31:28.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.h.service' 2024-09-13T18:31:28.781 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:28.782 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-13T18:31:28.782 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-13T18:31:28.783 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.k 2024-09-13T18:31:28.997 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:31:28 smithi067 systemd[1]: Stopping Ceph mds.k for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:29.497 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:31:29 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k[64550]: 2024-09-13T18:31:29.106+0000 7f1845b12640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:29.497 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:31:29 smithi067 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k[64550]: 2024-09-13T18:31:29.106+0000 7f1845b12640 -1 mds.k *** got signal Terminated *** 2024-09-13T18:31:32.247 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:31:31 smithi067 podman[71971]: 2024-09-13 18:31:31.882945336 +0000 UTC m=+2.883920152 container died b013519ee676a2018ec714db006200140bf40862650a10c0fd1259cd645c5edf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:31:32.727 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:31:32 smithi067 podman[71971]: 2024-09-13 18:31:32.31483353 +0000 UTC m=+3.315808347 container cleanup b013519ee676a2018ec714db006200140bf40862650a10c0fd1259cd645c5edf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T18:31:32.727 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:31:32 smithi067 bash[71971]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k 2024-09-13T18:31:32.727 INFO:journalctl@ceph.mds.k.smithi067.stdout:Sep 13 18:31:32 smithi067 podman[71983]: 2024-09-13 18:31:32.490788889 +0000 UTC m=+0.605115474 container remove b013519ee676a2018ec714db006200140bf40862650a10c0fd1259cd645c5edf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=) 2024-09-13T18:31:32.742 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.k.service' 2024-09-13T18:31:32.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:32.775 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-13T18:31:32.775 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-13T18:31:32.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.c 2024-09-13T18:31:33.077 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:31:32 smithi116 systemd[1]: Stopping Ceph mds.c for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:33.340 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:31:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c[65875]: 2024-09-13T18:31:33.075+0000 7f4fcee6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:33.340 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:31:33 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c[65875]: 2024-09-13T18:31:33.075+0000 7f4fcee6b640 -1 mds.c *** got signal Terminated *** 2024-09-13T18:31:36.145 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:31:35 smithi116 podman[71702]: 2024-09-13 18:31:35.865901302 +0000 UTC m=+2.898246529 container died 42402498b308713b12e3d2105fa3ae9902f92407eb28fccd589eb59a36ba5381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T18:31:36.460 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:31:36 smithi116 podman[71702]: 2024-09-13 18:31:36.241435259 +0000 UTC m=+3.273780466 container cleanup 42402498b308713b12e3d2105fa3ae9902f92407eb28fccd589eb59a36ba5381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:31:36.461 INFO:journalctl@ceph.mds.c.smithi116.stdout:Sep 13 18:31:36 smithi116 bash[71702]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-c 2024-09-13T18:31:36.627 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.c.service' 2024-09-13T18:31:36.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:36.663 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-13T18:31:36.663 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-13T18:31:36.663 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.f 2024-09-13T18:31:36.961 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:31:36 smithi116 systemd[1]: Stopping Ceph mds.f for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:37.461 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:31:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f[65574]: 2024-09-13T18:31:36.986+0000 7fdcfe9b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:37.461 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:31:36 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f[65574]: 2024-09-13T18:31:36.986+0000 7fdcfe9b5640 -1 mds.f *** got signal Terminated *** 2024-09-13T18:31:40.163 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:31:39 smithi116 podman[71836]: 2024-09-13 18:31:39.848038273 +0000 UTC m=+2.971044558 container died df9b330ee1299fe1a5027ac20c9a5873ee96713dfd7809801e29f20a911ffd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True) 2024-09-13T18:31:40.163 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:31:40 smithi116 podman[71836]: 2024-09-13 18:31:40.161226446 +0000 UTC m=+3.284232731 container cleanup df9b330ee1299fe1a5027ac20c9a5873ee96713dfd7809801e29f20a911ffd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True) 2024-09-13T18:31:40.461 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:31:40 smithi116 bash[71836]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f 2024-09-13T18:31:40.461 INFO:journalctl@ceph.mds.f.smithi116.stdout:Sep 13 18:31:40 smithi116 podman[71850]: 2024-09-13 18:31:40.387722673 +0000 UTC m=+0.536461173 container remove df9b330ee1299fe1a5027ac20c9a5873ee96713dfd7809801e29f20a911ffd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T18:31:40.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.f.service' 2024-09-13T18:31:40.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:40.566 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-13T18:31:40.566 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-13T18:31:40.566 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.i 2024-09-13T18:31:40.908 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:40 smithi116 systemd[1]: Stopping Ceph mds.i for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:41.210 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:40 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i[66183]: 2024-09-13T18:31:40.905+0000 7fd715136640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:41.211 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:40 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i[66183]: 2024-09-13T18:31:40.905+0000 7fd715136640 -1 mds.i *** got signal Terminated *** 2024-09-13T18:31:44.192 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:43 smithi116 podman[71957]: 2024-09-13 18:31:43.845415233 +0000 UTC m=+3.068586704 container died 1328e0a290ed4c199f77b5889c5f1f903a82d25ee27ec4d49d3a3e84d34c3e3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:31:44.460 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:44 smithi116 podman[71957]: 2024-09-13 18:31:44.265079294 +0000 UTC m=+3.488250750 container cleanup 1328e0a290ed4c199f77b5889c5f1f903a82d25ee27ec4d49d3a3e84d34c3e3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T18:31:44.461 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:44 smithi116 bash[71957]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i 2024-09-13T18:31:44.744 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.i.service' 2024-09-13T18:31:44.765 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:44 smithi116 podman[71971]: 2024-09-13 18:31:44.499545642 +0000 UTC m=+0.649806748 container remove 1328e0a290ed4c199f77b5889c5f1f903a82d25ee27ec4d49d3a3e84d34c3e3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T18:31:44.765 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:44 smithi116 systemd[1]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-13T18:31:44.765 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:44 smithi116 systemd[1]: Stopped Ceph mds.i for d9377e86-71fa-11ef-bceb-c7b262605968. 2024-09-13T18:31:44.765 INFO:journalctl@ceph.mds.i.smithi116.stdout:Sep 13 18:31:44 smithi116 systemd[1]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.i.service: Consumed 1.802s CPU time. 2024-09-13T18:31:44.777 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:44.777 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-13T18:31:44.777 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-13T18:31:44.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.l 2024-09-13T18:31:45.104 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:31:44 smithi116 systemd[1]: Stopping Ceph mds.l for d9377e86-71fa-11ef-bceb-c7b262605968... 2024-09-13T18:31:45.460 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:31:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l[65270]: 2024-09-13T18:31:45.101+0000 7f6c28358640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:31:45.461 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:31:45 smithi116 ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l[65270]: 2024-09-13T18:31:45.101+0000 7f6c28358640 -1 mds.l *** got signal Terminated *** 2024-09-13T18:31:48.211 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:31:47 smithi116 podman[72078]: 2024-09-13 18:31:47.86739997 +0000 UTC m=+2.880573830 container died 8ea9a734e015395864357544df7bce2ea095defeec2456326e7df143e16d5e5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:31:48.645 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:31:48 smithi116 podman[72078]: 2024-09-13 18:31:48.29310521 +0000 UTC m=+3.306279059 container cleanup 8ea9a734e015395864357544df7bce2ea095defeec2456326e7df143e16d5e5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T18:31:48.646 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:31:48 smithi116 bash[72078]: ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l 2024-09-13T18:31:48.646 INFO:journalctl@ceph.mds.l.smithi116.stdout:Sep 13 18:31:48 smithi116 podman[72093]: 2024-09-13 18:31:48.443970964 +0000 UTC m=+0.575999701 container remove 8ea9a734e015395864357544df7bce2ea095defeec2456326e7df143e16d5e5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-d9377e86-71fa-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:31:48.667 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d9377e86-71fa-11ef-bceb-c7b262605968@mds.l.service' 2024-09-13T18:31:48.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:31:48.699 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-13T18:31:48.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d9377e86-71fa-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:31:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:31:52.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d9377e86-71fa-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:31:52.673 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:31:54.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d9377e86-71fa-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:31:54.995 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:31:57.196 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:31:57.260 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:31:57.289 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:31:57.316 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T18:31:57.318 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi007/crash 2024-09-13T18:31:57.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:31:57.384 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:31:57.385 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:31:57.388 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi067/crash 2024-09-13T18:31:57.389 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:31:57.427 INFO:teuthology.orchestra.run.smithi067.stderr:tar: /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:31:57.428 INFO:teuthology.orchestra.run.smithi067.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:31:57.429 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi116/crash 2024-09-13T18:31:57.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:31:57.464 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /var/lib/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:31:57.464 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:31:57.465 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T18:31:57.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T18:31:57.540 INFO:teuthology.orchestra.run.smithi007.stderr:grep: /var/log/ceph/d9377e86-71fa-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T18:31:57.545 INFO:tasks.cephadm:Compressing logs... 2024-09-13T18:31:57.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:31:57.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:31:57.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:31:57.576 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:31:57.599 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:32:03.453 INFO:tasks.cephadm:Archiving logs... 2024-09-13T18:32:03.454 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi007/log 2024-09-13T18:32:03.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:32:03.915 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi067/log 2024-09-13T18:32:03.915 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:32:04.606 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi116/log 2024-09-13T18:32:04.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:32:05.062 INFO:tasks.cephadm:Removing cluster... 2024-09-13T18:32:05.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d9377e86-71fa-11ef-bceb-c7b262605968 --force 2024-09-13T18:32:05.287 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:32:05.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d9377e86-71fa-11ef-bceb-c7b262605968 --force 2024-09-13T18:32:05.908 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:32:06.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d9377e86-71fa-11ef-bceb-c7b262605968 --force 2024-09-13T18:32:06.315 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: d9377e86-71fa-11ef-bceb-c7b262605968 2024-09-13T18:32:06.579 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T18:32:06.579 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:32:06.619 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:32:06.635 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:32:06.650 INFO:tasks.cephadm:Teardown complete 2024-09-13T18:32:06.650 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:32:06.664 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:32:06.664 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:32:06.669 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:32:06.677 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:32:06.821 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:32:06.830 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:32:06.830 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:32:06.834 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:32:06.837 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:32:06.849 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:32:06.851 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:32:06.854 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:32:06.855 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-13T18:32:06.855 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 -1039us[-1036us] +/- 51ms 2024-09-13T18:32:06.855 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +2788us[+2791us] +/- 69ms 2024-09-13T18:32:06.855 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -1329us[-1329us] +/- 70ms 2024-09-13T18:32:06.855 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:32:06.856 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:32:06.856 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-13T18:32:06.856 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 -1018us[-1020us] +/- 51ms 2024-09-13T18:32:06.856 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 +2812us[+2810us] +/- 69ms 2024-09-13T18:32:06.856 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 41 -1313us[-1315us] +/- 69ms 2024-09-13T18:32:06.856 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:32:06.865 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:32:06.873 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:32:06.873 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-13T18:32:06.873 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 -1040us[-1042us] +/- 51ms 2024-09-13T18:32:06.873 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 +2777us[+2775us] +/- 69ms 2024-09-13T18:32:06.873 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -1316us[-1316us] +/- 70ms 2024-09-13T18:32:06.874 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:32:06.874 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:32:06.884 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:32:06.884 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:32:06.894 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:32:07.045 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:32:07.114 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:32:07.182 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T18:32:07.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:07.243 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T18:32:07.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:07.271 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T18:32:07.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:07.299 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:32:07.310 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:32:07.320 INFO:teuthology.task.internal:Duration was 1947.806727 seconds 2024-09-13T18:32:07.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:32:07.329 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:32:07.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:32:07.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:32:07.336 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:32:07.373 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:32:07.378 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:32:07.417 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:32:07.789 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:32:07.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T18:32:07.789 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:32:07.840 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-09-13T18:32:07.841 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:32:07.869 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-13T18:32:07.870 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:32:07.896 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:32:07.896 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:32:07.900 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:32:07.912 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:32:07.962 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:32:07.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:32:07.966 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:32:07.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:32:08.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:32:08.455 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:32:08.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:32:08.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:32:08.536 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:32:08.562 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:32:08.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:32:08.579 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:32:08.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:32:08.602 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-09-13T18:32:08.626 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-13T18:32:08.645 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-13T18:32:08.675 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:32:08.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:08.709 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:32:08.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:08.723 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:32:08.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:08.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:32:08.748 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:32:08.749 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi007 2024-09-13T18:32:08.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:32:08.822 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi067 2024-09-13T18:32:08.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:32:08.858 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903957/remote/smithi116 2024-09-13T18:32:08.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:32:08.897 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:32:08.898 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:32:08.902 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:32:08.905 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:32:08.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:32:08.959 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:32:08.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:32:08.970 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:32:08.970 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:32:08.978 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:32:08.980 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:32:08.992 INFO:teuthology.orchestra.run.smithi067.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:32 /home/ubuntu/cephtest 2024-09-13T18:32:09.001 INFO:teuthology.orchestra.run.smithi116.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:32 /home/ubuntu/cephtest 2024-09-13T18:32:09.009 INFO:teuthology.orchestra.run.smithi007.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:32 /home/ubuntu/cephtest 2024-09-13T18:32:09.011 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:32:09.022 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:32:09.113 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/test_o_trunc}} duration: 1947.8067271709442 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:32:09.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:32:09.209 INFO:teuthology.run:pass